-- Logs begin at Fri 2022-06-17 07:38:26 UTC, end at Fri 2022-06-17 09:05:12 UTC. -- Jun 17 08:14:52.069981 dv-cinder-803773-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 08:14:52.077745 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:14:52 2022] *** Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: nodename: dv-cinder-803773-4-iscsi Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: machine: x86_64 Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: clock source: unix Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: pcre jit disabled Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: detected number of CPU cores: 4 Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: current working directory: / Jun 17 08:14:52.079741 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: your processes number limit is 47680 Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: your memory page size is 4096 bytes Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: detected max file descriptor number: 2048 Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: lock engine: pthread robust mutexes Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: thunder lock: enabled Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 08:14:52.080372 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:14:52.124947 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: Python main interpreter initialized at 0x5563875689c0 Jun 17 08:14:52.124947 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: python threads support enabled Jun 17 08:14:52.124947 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: your server socket listen backlog is limited to 100 connections Jun 17 08:14:52.124947 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:14:52.125315 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:14:52.125424 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: *** Operational MODE: preforking *** Jun 17 08:14:52.125674 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:14:52.125674 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: spawned uWSGI master process (pid: 80250) Jun 17 08:14:52.125915 dv-cinder-803773-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 17 08:14:52.128530 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: spawned uWSGI worker 1 (pid: 80264, cores: 1) Jun 17 08:14:52.128530 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: spawned uWSGI worker 2 (pid: 80265, cores: 1) Jun 17 08:14:52.128530 dv-cinder-803773-4-iscsi devstack@keystone.service[80250]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:14:57.772985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:14:57.772985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes Jun 17 08:14:57.773770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:14:57.773770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes Jun 17 08:14:57.774878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:14:57.774878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: from cryptography.utils import int_from_bytes Jun 17 08:14:57.775316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:14:57.775316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: from cryptography.utils import int_from_bytes Jun 17 08:14:57.830103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:14:57.830302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:14:57.830442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:14:57.830540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] command line args: [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:14:57.830626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:14:57.830758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] command line args: [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:14:57.830855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:14:57.830925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ================================================================================ {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:14:57.831070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:14:57.831176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] admin_token = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ================================================================================ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:14:57.831414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] config_dir = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_dir = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] config_source = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.831981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] debug = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_source = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] debug = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.832819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_config_append = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_config_append = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.833951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_dir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_dir = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_file = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.834977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.835916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.836876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.837033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.837114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.925538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] publish_errors = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] publish_errors = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.928966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] standard_threads = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] standard_threads = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] use_journal = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] use_json = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.929965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] use_stderr = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_journal = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] use_syslog = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_json = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_stderr = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_syslog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.930499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:14:57.930558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.930619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.930679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.930743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.931996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.932909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.933956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.934907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.935863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.936904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.937894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.938938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.939868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.940924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.941995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.942951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.943918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.944974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.945935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.946898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.947660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.948929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.949917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.950851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.951996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.952976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.953988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.954938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.955933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.external = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.external = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.956966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.password = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.password = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957483 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.token = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] auth.token = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.957963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.958959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.959912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.960915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.961912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.962956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.963942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.964113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.964192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.964348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.964426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.964613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.965983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.966966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.967949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.968929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.969897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.970876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.971875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.972850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.973804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.974962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.975994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.976984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.979953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.980096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.980167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.980236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.980236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.981993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.982945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.983939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.984924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.985990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.986940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.987993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.988978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.989987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990629 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.990950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.991974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] role.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] role.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.992932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.993949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.994928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.995825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.996964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.997979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.998965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:57.999942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.000998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.001978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.002968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.003944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.004945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.connection = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.005983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.006929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.007962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.008943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:14:58.009595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.009816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.010058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:14:58.010232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:14:58.040333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.040512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.040751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.041024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.041262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.041493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.049312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.050471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.078096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.078328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.079314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.079549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.156238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.156476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.205541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.205687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.205754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.205827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282603 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.282921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.283721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.306966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.307787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.318915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.319242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.339741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.340334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.340548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.340790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.340870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.340959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.341081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.341163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80265) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.341299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:14:58.358536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.358745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:14:58.358922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.359081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.359164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:14:58.359281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:14:58.359449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.359541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.359648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:14:58.359795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.359911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.360053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.360167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.360309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.360421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.360698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.371881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.372134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.377421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.380981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.381430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.384369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.384673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.384772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.384958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.385860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.386044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.386123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.386311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.386393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.386640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.387251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.387415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.387944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.388160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.388439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.388728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.414672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.415626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.416342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.416645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.417296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.417571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.422124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.425031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.425031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.425158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.425158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.425158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.430132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.430415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.431161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.431437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.435682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.435961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.436239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.436579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.436859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.436941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.437131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.437963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.438233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.438501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.438766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.456607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.456886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.457901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.458174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.461409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.462746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.465644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.466073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.467339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.467733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.471118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.474514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.474897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.476272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.478551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.478848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.479129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.479409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.479725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.479888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.480004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.480180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.481621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.481910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.482186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.482479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.501627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.501912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.502180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.502443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.503322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.503601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.503864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.504123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.510459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.512315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.512416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.512971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.514308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.514645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.516219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.516520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.516804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.517098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.517374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.517763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.518040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.518316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.518603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.518872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.531512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.531910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.532231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.532532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.532910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.533128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.533210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.533421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.533517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.533695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.533979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.534347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.534619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.534891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.551998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.553702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.555272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.557011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.558771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.560786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.560929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.562503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.566235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.566235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.566235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.566488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.566488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.566488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.570569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.571897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.572228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.573534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.575699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.575983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.576386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.576695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.577228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.577514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.577906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.578192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.585947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.586230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.586507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.587244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.587529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.587802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.595271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80265) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.595550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.595828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.596101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.596947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.596947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:14:58.597147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597354 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.597915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.598945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80265) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.599027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.599229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.599495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.599759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.600028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.600295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:14:58.637932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563875689c0 pid: 80265 (default app) Jun 17 08:14:58.640288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563875689c0 pid: 80264 (default app) Jun 17 08:14:58.641390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab083a-2044-4a65-a0db-9a922fa8c295 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:14:58.641691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab083a-2044-4a65-a0db-9a922fa8c295 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:14:58.641967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab083a-2044-4a65-a0db-9a922fa8c295 None None] PATH_INFO: `/v3` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:14:58.646375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Jun 17 08:14:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:07.657916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:07.658441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:07.658521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:07.662806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:07.668114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:07.668670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:07.668670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:07.748875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: INFO dbcounter [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] Registered counter for database keystone Jun 17 08:15:07.770727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG oslo_db.sqlalchemy.engines [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:15:07.776923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writer thread running {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:15:07.965674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG passlib.handlers.bcrypt [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80265) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 08:15:07.966019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG passlib.handlers.bcrypt [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80265) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 08:15:08.020857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:08.022466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:08.146163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 17 08:15:08.294624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:08.364894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: INFO dbcounter [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] Registered counter for database keystone Jun 17 08:15:08.384253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG oslo_db.sqlalchemy.engines [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:15:08.390823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writer thread running {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:15:08.508924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5b92-5f88-4f0a-906d-07ffec8393df None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:08.513587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:08.514244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:08.514531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:08.514807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:08.522859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:08.575455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING keystone.common.rbac_enforcer.enforcer [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 08:15:08.575732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a0769-b44c-4607-bc33-0c2ded28196a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:08.585689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 17 08:15:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:15:08.592211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:08.607560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06d1ae-13f6-4851-b1b6-617ce69be02b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:08.612141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:08.613304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:08.613589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:08.613864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] PATH_INFO: `/v3/projects/82d4449a875a4811837ecf2ea9ba71ec` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:08.615401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] RBAC: Authorizing `identity:get_project(project_id=82d4449a875a4811837ecf2ea9ba71ec)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:08.666113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 08:15:08.666461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb2b2f-e8bc-4b03-b01c-caa345b709df admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:08.671971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Jun 17 08:15:08 2022] GET /identity/v3/projects/82d4449a875a4811837ecf2ea9ba71ec => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:10.798432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104d90-e621-467b-82a1-d94be05cbfeb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:10.798977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104d90-e621-467b-82a1-d94be05cbfeb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:10.798977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104d90-e621-467b-82a1-d94be05cbfeb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:10.803198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:10.808788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:10.809191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:10.809346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:10.827842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:10.829407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:10.837524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 08:15:10.860763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c104d90-e621-467b-82a1-d94be05cbfeb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:10.872788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c104d90-e621-467b-82a1-d94be05cbfeb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:10.877019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:10.877652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:10.877935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:10.878211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:10.885923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:10.887975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc9fd3-a2ca-4d0b-8f25-4ebd976f87c8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:10.896756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 17 08:15:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:15:10.902823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:10.912073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8867e-35c6-4d19-809c-70a7c089c2ee None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:10.916601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:10.918150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:10.918495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:10.918775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:10.920188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:10.922069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c487e7e-234d-4efd-8afb-048cd6ac4f51 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:10.923655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Jun 17 08:15:10 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:13.115678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8329-dc96-4209-b365-ef3ca2b04335 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.116176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8329-dc96-4209-b365-ef3ca2b04335 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.116246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8329-dc96-4209-b365-ef3ca2b04335 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.117618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:13.123341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.123756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.123958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.142470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:13.143667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:13.148732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b09d4c-5201-4f52-9564-351000bd5d88 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.149024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b09d4c-5201-4f52-9564-351000bd5d88 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.149306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b09d4c-5201-4f52-9564-351000bd5d88 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.150654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:13.155797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.156103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.156449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.196752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80264) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 08:15:13.197178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80264) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 08:15:13.223925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:13.242718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:13.244299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:13.246976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.271453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.344289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:13.352028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbddc1-5848-44d9-9528-bd49fc410a09 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.366537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.385909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.387535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.387819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.388096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.399197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:13.410562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:13.411397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:13.412392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:13.417928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.468919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d07af-58a2-4996-bb3d-5ca91594534e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.471180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.499898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.506905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.507807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.508094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.508368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.519405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a94ae0-8a6b-4cc6-b6df-08b6cf488c6e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.553064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.553728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.554011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.554299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.555040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:13.555347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:13.556770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:13.569066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:13.574388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.577209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:13.579711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:13.674887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6b1b-6e7d-446f-8f47-430b23734dc6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.677924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:13.684175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.687716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.708568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.709442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.709720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.709992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.711197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:13.712694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:13.714481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:13.719792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.736169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.792149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb044-ab49-4957-8832-01193607ed52 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.824194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21107509-40e8-41cf-8ea8-096572df28a7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.825025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.825819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.826096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.826370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.845312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:13.846932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:13.858450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:13.859335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:13.859687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:13.860032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:13.861232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:13.862661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:13.864259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:15:13.868531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:13.869370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:13.870182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:15:13.870182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:15:13.870182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:15:13.870182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:13.870182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:13.871538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.875670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:13.938509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.956758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:13.975457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c81ab-c170-467e-9075-0370793097d9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:13.982799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e604091-f9cd-46f4-a158-f021c9bc36f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:14.008847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:14.009506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:14.009789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:14.010072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:14.010913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.domain.id=default, user.id=cbbc2703cf604866b1601e5d461198e6) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:14.011327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:14.013112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399a84-be4f-4b05-b0f1-5eb435a4a96b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:14.015739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:14.016400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:14.016713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:14.017008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:14.017739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:14.018047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:14.019430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675db07-34c6-4d59-9dad-5fd1856c261d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:14.019822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/role_assignments?user.id=cbbc2703cf604866b1601e5d461198e6&scope.domain.id=default&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:14.039440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:16.438679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb0a5-8294-4d20-8902-89df1a6132fa None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:16.439191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb0a5-8294-4d20-8902-89df1a6132fa None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:16.439263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb0a5-8294-4d20-8902-89df1a6132fa None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:16.440609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:16.446284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba35f6-b308-4f11-8879-010a6e890d81 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:16.446681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba35f6-b308-4f11-8879-010a6e890d81 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:16.446845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba35f6-b308-4f11-8879-010a6e890d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:16.466543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-84ba35f6-b308-4f11-8879-010a6e890d81 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:16.468045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84ba35f6-b308-4f11-8879-010a6e890d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:16.558891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:16.596998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb0a5-8294-4d20-8902-89df1a6132fa None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:16.670116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4721-42bc-47cb-8101-9ff13c89b80a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:16.670749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4721-42bc-47cb-8101-9ff13c89b80a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:16.671226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4721-42bc-47cb-8101-9ff13c89b80a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:16.672873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:16.678202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:16.678759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:16.679233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:16.705733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:16.707256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:16.774713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:16.819625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:16.821272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb0a5-8294-4d20-8902-89df1a6132fa None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:16.862109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:16.880124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:16.880979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:16.881267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:16.881548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:16.912510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:16.925649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:16.926496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:16.927228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:16.934094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:16.943048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:17.019333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e042fd-6da6-4d84-b6b8-25a526ddf5f9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.063011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.064056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.065241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.065926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.068331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.069961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066ee6-c73a-4547-8449-df26b8280efa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.143918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574442-c24e-4d37-be8c-eba249ff7462 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.182177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.182967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.183252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.183539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.192507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:17.192507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.192507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483044-89e4-4d8a-8f98-a30412dec4e7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.198923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:17.200399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fcf3-cedd-4c31-aec1-4cf6ae18d4c4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.200722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fcf3-cedd-4c31-aec1-4cf6ae18d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.201007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fcf3-cedd-4c31-aec1-4cf6ae18d4c4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.212518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:17.212518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fcf3-cedd-4c31-aec1-4cf6ae18d4c4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.300972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:17.340770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fcf3-cedd-4c31-aec1-4cf6ae18d4c4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.376773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.377984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.378495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.378968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.379557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 14/29] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 08:15:16 2022] POST /identity/v3/roles => generated 219 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:15:17.383880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.384759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.385055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.385339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.386950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee679-ad7f-4d3a-a5bb-2afc955f57af None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.394006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:17 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:17.396106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7bbe-4a15-4265-b80a-194da87e48ae None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.396675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7bbe-4a15-4265-b80a-194da87e48ae None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.397270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7bbe-4a15-4265-b80a-194da87e48ae None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.399052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 17/31] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:17.400535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7bbe-4a15-4265-b80a-194da87e48ae None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.433913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:17.435546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:17.529011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7bbe-4a15-4265-b80a-194da87e48ae None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.530223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:17.575413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.577032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.577550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.578074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.579720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.581704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39f82c-c558-4dbe-be89-363c13b92d6b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.585466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 18/32] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:17.587352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.587908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.588379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.608868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:17.611229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:17.612770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:17.636513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:17.636513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.714185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:17.715823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.787862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe14f3-67da-4085-b16c-547c4b38f8e8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.834769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.838054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.838533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.839524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] PATH_INFO: `/v3/domains/default/users/cbbc2703cf604866b1601e5d461198e6/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.843315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cbbc2703cf604866b1601e5d461198e6, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.845411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.857433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530145-bf37-43a1-9d85-e30e8a1b42ff None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:17.891490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:17.899387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:17.900506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:17.900988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:17.902156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:17.913652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:17.915176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:15:17.934051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:17.934923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:17.935694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:15:17.935694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:15:17.935694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:15:17.935694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:17.936388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 20/35] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:17.937541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.958481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 16/36] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Jun 17 08:15:17 2022] PUT /identity/v3/domains/default/users/cbbc2703cf604866b1601e5d461198e6/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:17.959588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:17.995439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:18.090214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e142f83-3016-43fb-82d2-e44886988f18 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.198947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf01466-2ef3-4c01-8b1e-946e38b49d4f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.242355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.243036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.243324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.243602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.244541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.247187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9dfa-9d73-430e-85e5-59b40d655e00 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.251031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.251952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.252430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.252946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.254049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:18.254601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.256222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357449-84af-4ff5-909f-308c2d7c7a35 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.268975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 17/37] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:18.270302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657149-1f3e-4015-a2f1-76a4dfe21c16 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.270591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657149-1f3e-4015-a2f1-76a4dfe21c16 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.270870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657149-1f3e-4015-a2f1-76a4dfe21c16 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.272250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:18.273177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051617-5e5a-4ad8-8235-fccb4404a81d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.273461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051617-5e5a-4ad8-8235-fccb4404a81d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.273824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051617-5e5a-4ad8-8235-fccb4404a81d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.274954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:18.275625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051617-5e5a-4ad8-8235-fccb4404a81d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:18.366911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:18.383044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051617-5e5a-4ad8-8235-fccb4404a81d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.424527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 08:15:17 2022] POST /identity/v3/roles => generated 225 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:18.424527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402471-1c63-4348-a8ee-8de05b722299 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.424527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402471-1c63-4348-a8ee-8de05b722299 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.424527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402471-1c63-4348-a8ee-8de05b722299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.429833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.430604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.430953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.431302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.432102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.434329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.443384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9a402471-1c63-4348-a8ee-8de05b722299 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:18.445395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9a402471-1c63-4348-a8ee-8de05b722299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:18.498156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:18.530420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:18.535621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.535621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.535621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.558881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:18.560297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:18.572611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:15:18 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:18.576234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:18.665660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:18.695671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:18.725701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901c0ed-ae4b-4ac7-bf6e-1a26915c763b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.779028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.780358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.780835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.781260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.782812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.785031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.787182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:18.793849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:18.803757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:18.829382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b07a62-5e0f-4522-9495-95d6728a47d1 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.832951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:18.872459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.873893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.873893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.873893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.874595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.876126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cbc1-9e24-486c-86a2-d87289406e8e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.909244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3aff-d830-4cb4-a0ef-a67c2b878523 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:18.944663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:18.945265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:18.945552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:18.945832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:18.946544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:18.948004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f803a-bfad-4fbf-958f-2525fa1ef4b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:18.960580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 08:15:18 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:19.075883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:15:18 2022] POST /identity/v3/projects => generated 312 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:20.246196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb268-e59f-474e-a148-52a95f7e2b63 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.246196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb268-e59f-474e-a148-52a95f7e2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.246196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb268-e59f-474e-a148-52a95f7e2b63 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.358899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:20.358998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:20.359833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:20.367422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bb268-e59f-474e-a148-52a95f7e2b63 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:20.467334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bb268-e59f-474e-a148-52a95f7e2b63 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:20.499739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:20.500476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.500790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.501074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.511442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:20.519465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:20.520474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:20.521331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:20.526414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:20.621983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450622-bf84-4300-857a-d0c8373ae2e1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:20.661968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:20.662648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.662938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.663218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.663980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:20.664290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:20.665724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:20.678004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 24/50] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:20.683327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:20.708278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:20.781885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b275c1-dc2a-4fcd-9bcf-45ab2b9e27df None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:20.815389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:20.816271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.816581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.816862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.818067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:20.819530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:20.821203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 27/51] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:20 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:20.826645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:20.876973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:20.927189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604d0c-789e-4b40-bc69-b3d89b2d772f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:20.959896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:20.960714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:20.961002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:20.961280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:20.962472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:20.964042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327fb2-e2eb-49d8-9aa8-6b88b93a7f41 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:20.970272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 25/52] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:20.971503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:21.068837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:21.077128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cfa93-5da9-4881-a920-f49985968157 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:21.110372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:21.111032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:21.111318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:21.111596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:21.112430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.domain.id=default, user.id=cbbc2703cf604866b1601e5d461198e6) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:21.112773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:21.114542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3cf0-7edc-48b0-a341-5422d8100433 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:21.121913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 28/53] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 17 08:15:20 2022] GET /identity/v3/role_assignments?user.id=cbbc2703cf604866b1601e5d461198e6&scope.domain.id=default&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:21.243583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00081-8eaa-4497-b6bf-30ef875887b9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:21.243994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00081-8eaa-4497-b6bf-30ef875887b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:21.244279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00081-8eaa-4497-b6bf-30ef875887b9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:21.246576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 26/54] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:21.253739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:21.254268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:21.254355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:21.271964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:21.273209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:21.342886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 29/55] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:21.366596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00081-8eaa-4497-b6bf-30ef875887b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:21.465893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00081-8eaa-4497-b6bf-30ef875887b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:21.482655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:21.498022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:21.498855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:21.499137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:21.499412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:21.500612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:21.502070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022a1c-9c2d-472a-8542-da00bff1d093 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:21.503669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 27/56] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:21.509223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:21.592533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:21.612442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5af1-8088-4c83-8254-e25ded6b956c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:21.640732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:21.641460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:21.641745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:21.642024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:21.642754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:21.644266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ecc12-b740-496d-89fe-a82064c3813d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:21.754307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 30/57] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 17 08:15:21 2022] POST /identity/v3/projects => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:15:23.861371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360199-f0ce-4bdb-8174-b79722ce05f8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:23.861915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360199-f0ce-4bdb-8174-b79722ce05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:23.861915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360199-f0ce-4bdb-8174-b79722ce05f8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:23.863292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 28/58] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:23.868287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:23.868708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:23.868876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:23.886618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:23.888067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:23.953345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:23.977042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360199-f0ce-4bdb-8174-b79722ce05f8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:24.076671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360199-f0ce-4bdb-8174-b79722ce05f8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:24.109733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:24.110519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:24.110804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:24.111081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:24.112454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:24.113902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3ba9-e287-4947-93e2-572811093bf8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:24.115511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 29/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:24.121014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:24.186080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:24.218845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddd46f-2da2-4a7e-9138-7b7330289e46 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:24.252190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:24.252890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:24.253179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:24.253461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:24.254263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:24.255701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbb0de-2e26-4b0c-9d98-df060528656d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:24.368705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:24 2022] POST /identity/v3/users => generated 275 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:27.526313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-b698-4100-9644-1127593888a8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:27.527401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-b698-4100-9644-1127593888a8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:27.527885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8f934-b698-4100-9644-1127593888a8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:27.529511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 30/62] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:27.534836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010051e-cbde-4d30-abdd-7f80adf436b7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:27.535690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010051e-cbde-4d30-abdd-7f80adf436b7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:27.536169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010051e-cbde-4d30-abdd-7f80adf436b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:27.561467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d010051e-cbde-4d30-abdd-7f80adf436b7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:27.563013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d010051e-cbde-4d30-abdd-7f80adf436b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:27.655338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 33/63] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:27.657223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b727-087b-49b9-97eb-052842c4a146 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:27.657727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b727-087b-49b9-97eb-052842c4a146 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:27.658206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b727-087b-49b9-97eb-052842c4a146 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:27.663188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:27.664964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:27.665265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:27.665550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:27.688001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:27.689333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:27.720184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b727-087b-49b9-97eb-052842c4a146 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:27.749385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:27.772861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 34/65] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:27.816983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:27.842450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:27.941177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b727-087b-49b9-97eb-052842c4a146 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.014587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.015408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.015688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.015959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.024868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce085bb-a6c7-4a71-9936-f67efe7708c7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.046663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:28.055908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:28.057435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:28.058329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:28.070080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 32/66] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:28.076686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.132966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.134286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.134792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.135884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.149247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fc703292-6673-4ad9-85d4-5892d1fa220b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:28.158024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:28.158946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:28.159746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:28.162704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 35/67] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:28.169630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387d39-e400-426f-a9c5-a04a81cebdb9 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.170235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387d39-e400-426f-a9c5-a04a81cebdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.170759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387d39-e400-426f-a9c5-a04a81cebdb9 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.172721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 36/68] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:28.173780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387d39-e400-426f-a9c5-a04a81cebdb9 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.211608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dec0-d235-4578-9516-2f7f5c984d6d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.226404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.231920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.247128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.247809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.248098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.248377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.249204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:28.249537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.250938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba3b15-ca97-4697-ab7f-dd01cd57ee3e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:28.259367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 33/69] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:28.261407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.262588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.263297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.279671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:28.280941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:28.289879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387d39-e400-426f-a9c5-a04a81cebdb9 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.323517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.324247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.324566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.324852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.325613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:28.325925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.327327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64687-6a41-4e8f-840c-05db78f04d9e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:28.335244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 37/70] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:28.336449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1013-6265-4f9b-89b2-665de9c30175 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.336772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1013-6265-4f9b-89b2-665de9c30175 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.337054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1013-6265-4f9b-89b2-665de9c30175 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.338488 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 38/71] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:28.342715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e2ce-79d7-42ef-b706-02a3cbaa6aa6 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.342715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e2ce-79d7-42ef-b706-02a3cbaa6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.342715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e2ce-79d7-42ef-b706-02a3cbaa6aa6 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.342715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 39/72] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:28.342715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e2ce-79d7-42ef-b706-02a3cbaa6aa6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.356398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 34/73] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:28.358303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.449593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e2ce-79d7-42ef-b706-02a3cbaa6aa6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.457151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.465879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3d0d8-20be-4255-ae96-24530197c35f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.482738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.484042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.484957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.485242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.485519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.499211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.500076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.500712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836d7e7-f2b0-427d-b519-3c897ee0ebe7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:28.500989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.501275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.501554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.502404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 40/74] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:28.507111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.507215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.507215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.507215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.507445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccb06c-113d-4ab4-b2ed-cafd8a7c9bfb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:28.507445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 35/75] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:28.507445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.507445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.507722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.525321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:28.525529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:28.526536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:28.526779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:28.592030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 41/76] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:28.592983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.602598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 36/77] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:28.605376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.686662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.692746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b3a5d-3e19-4251-b51b-8799181f8f71 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.709145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93f8e4-4f1f-4bb2-ac55-b3e98cd15ece None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.711424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.725294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.726114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.726399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.726684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.737448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:28.743464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.744111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.744784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.745066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:28.745549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:28.746374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 42/78] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:28.752350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.812206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.813745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:28.845808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0baf-557c-4a41-8556-4a1c1e7fcdef None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:28.878179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:28.878829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:28.879115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:28.879400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:28.903972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.910294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 37/79] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:28.911148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:28.915623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:28.950574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:28.952072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.008580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575600e-ffdf-445a-bce5-60163da63de7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.041640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.042505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.042787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.043064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.044224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.045687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.047479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 38/80] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.047599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:29.048186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.049324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.102275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.120581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.147707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab452-3bcd-4866-ba7a-43f3d87e3c38 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.149175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800962-3e5f-48a5-bb85-b627aef61f9e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.181189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.181800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.181979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.182265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.182543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.182861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.183150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.183288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:29.183426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.183592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.185004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.192797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 44/82] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.193576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.193690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:29.201970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:29.202867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:29.203645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 39/83] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:29.204258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.295316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59370-07d4-4258-a188-f1b01da4f7b3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.305221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fda5c-a6ed-40f4-82f6-45bb4b93f2fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.310795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.328158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.329055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.329338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.329615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.330893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.332348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.334243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 45/84] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.334809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.340557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.345461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.346330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.346677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.346957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.348173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.349691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.351412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 40/85] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.359683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.432882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70406bbb-faa0-470f-88eb-f7a5c3f14cb3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.448447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46e3c-3847-4194-8d34-b4d10dc3b4ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.466283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.466960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.467267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.467555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.468264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.469761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.481594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.482461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.482739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.483009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.484205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.485686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.487322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 41/86] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.495573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.552538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.564943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 46/87] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:29 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:29.575948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.588777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d4ec-f5c9-4030-bc2f-a82ec52b99bf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.611775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.626124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.626823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.627120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.627391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.628171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:29.628511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.630253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.640222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 42/88] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.641137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.680054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982a4bb-7be5-4322-9d0c-bacc8c625d9c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.717315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.717991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.718445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.718726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.719578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:29.719971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.721437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.731202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 47/89] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.731202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.779891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf948-0a40-4f09-91aa-45493849e365 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.818567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.828952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.830507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.830797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.831074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:29.831931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=cbbc2703cf604866b1601e5d461198e6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:29.832521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:29.833788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:29.848119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 43/90] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/role_assignments?user.id=cbbc2703cf604866b1601e5d461198e6&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:29.849036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:29.882954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb51b-4c67-486b-a200-d5eece5c89d9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:29.888229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:29.944846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:29.946094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:29.946387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:29.946828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.014322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430275db-0847-4638-9ea1-a43cc615aa05 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:30.049920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.051772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.066439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:30.067403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:30.067695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:30.067979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.070054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.071825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.076107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 44/91] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:30.082950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:30.199311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 48/92] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:30.209679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:30.214717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:30.222111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:30.302758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58c6f3-7a59-4e3f-8ac3-d1c598497b71 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:30.331360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2763a8-7c93-4bff-94f1-c031c249bfbf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:30.372588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:30.373733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:30.374171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:30.374308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:30.374712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.375100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:30.375514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:30.375876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.376638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.378254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.380129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 49/93] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:30 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:30.387248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:30.478696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:30.511477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c008-bc33-4446-9d7b-ecb6a3f913f6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:30.534546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.536257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.552814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:30.553668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:30.554061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:30.554448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.556010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:30.556435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.559127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.568270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 50/94] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:30 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=b5c3b136cc84423fb874b4d72253033e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:30.700515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:30.733721 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 45/95] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:30.741879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:30.890931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff212313-46cd-4145-944e-d4ff1030c246 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:30.935981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:30.937157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:30.937588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:30.938011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] PATH_INFO: `/v3/projects/bfbd696121a04c6fb6e856fb82b9d836` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:30.939457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] RBAC: Authorizing `identity:get_project(project_id=bfbd696121a04c6fb6e856fb82b9d836)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:30.941110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687edf6-b462-4cb5-8715-7276c432d498 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:30.942965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 51/96] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:30 2022] GET /identity/v3/projects/bfbd696121a04c6fb6e856fb82b9d836 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:30.949550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:31.181918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdfe4-d91e-4831-8829-c5fee0e1515a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:31.233413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:31.234455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:31.234939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:31.235414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:31.236450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=bfbd696121a04c6fb6e856fb82b9d836, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:31.236973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:31.238676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d409e3-b643-4a80-8063-497663b8e5dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:31.245381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 46/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:30 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=bfbd696121a04c6fb6e856fb82b9d836&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:33.195672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c72a1-0a69-453c-a2a9-21113721e963 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.196758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c72a1-0a69-453c-a2a9-21113721e963 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.197344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c72a1-0a69-453c-a2a9-21113721e963 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.199066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 52/98] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:33.201033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e225-d206-4035-a57e-e782c9478a5a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.201913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e225-d206-4035-a57e-e782c9478a5a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.202410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e225-d206-4035-a57e-e782c9478a5a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.205066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831747-5cb3-4800-a9bd-cac7dc3cc654 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.205617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831747-5cb3-4800-a9bd-cac7dc3cc654 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.206096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831747-5cb3-4800-a9bd-cac7dc3cc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.216994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.225417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 47/99] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:33 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:33.231505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.236582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.236582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.251060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8a831747-5cb3-4800-a9bd-cac7dc3cc654 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:33.252602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8a831747-5cb3-4800-a9bd-cac7dc3cc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:33.271114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:33.272665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:33.316813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.382763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:33.384118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242a81-72d3-45ff-be5c-950dac686b68 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.384408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242a81-72d3-45ff-be5c-950dac686b68 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.384826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242a81-72d3-45ff-be5c-950dac686b68 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.386253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 54/101] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:33.392039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.392322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.392631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.403386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 48/102] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:33.413550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:33.414740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:33.432674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:33.549510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 55/103] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:33.550209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:33.632534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d9c12-b3ff-4946-ace2-3f2e343cf545 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:33.654643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.678037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:33.679184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.679673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.680172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.692196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:33.700291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:33.701152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:33.701871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:33.702450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 49/104] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:33.702512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f2320-26d5-4f69-9f77-ba83c463f1b8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:33.703063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:33.724988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.741769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:33.742585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.742968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.743256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.754310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-939d473a-7baa-4415-bb2f-6b0fdeaf47c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:33.762695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:33.763554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:33.764304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 56/105] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:33.765775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21a5f-88a0-4c8f-ad7f-7978d92f8248 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.766058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21a5f-88a0-4c8f-ad7f-7978d92f8248 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.766340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21a5f-88a0-4c8f-ad7f-7978d92f8248 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 57/106] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13479e3-6d1b-4374-bbe1-c63cbd0fca39 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13479e3-6d1b-4374-bbe1-c63cbd0fca39 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13479e3-6d1b-4374-bbe1-c63cbd0fca39 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 58/107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:33.771706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13479e3-6d1b-4374-bbe1-c63cbd0fca39 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:33.819712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32251-b020-4a48-99d2-7332354a7589 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:33.857069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:33.857985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.858275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.858669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.860023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:33.861581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:33.863329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 50/108] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:33.866509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:33.879954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13479e3-6d1b-4374-bbe1-c63cbd0fca39 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:33.910462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.928245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:33.929049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.932396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.932396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.932396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:33.932396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:33.932396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b6706-81d6-4724-985b-c78ca8b5b929 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:33.940476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 59/109] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:33.941699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebcb4-be49-4e98-bc49-751b29c97f60 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:33.941998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebcb4-be49-4e98-bc49-751b29c97f60 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:33.942283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebcb4-be49-4e98-bc49-751b29c97f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:33.959438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-457ebcb4-be49-4e98-bc49-751b29c97f60 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:33.960663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-457ebcb4-be49-4e98-bc49-751b29c97f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:33.972463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:33.989212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5008bef-370e-4ab9-acc4-17d9b6a9d385 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.031269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 60/110] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:34.031637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.032470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.032876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.033374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.033566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.033910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.034065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.034951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:34.035424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.036910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.052099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 51/111] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.052099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.062625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:34.063829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:34.144517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 61/112] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:34.144517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.170058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be76-5444-4365-8d06-67762925a904 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.190724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.206458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.207137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.207427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.207811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.208544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.210004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.246675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416d467-4a72-49a5-9930-ff2a06e40d0e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.279831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.280738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.281059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.281335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.282514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.283994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.285759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 62/113] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.286594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.325311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.333470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 52/114] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:15:34 2022] POST /identity/v3/projects => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:34.334276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.414953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c313cc-0f17-44e8-a321-0c973501a1a2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.436835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.460529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.463529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.464020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.464507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.466246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.468039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.471829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84da6-7a93-4d14-89be-8757371af456 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.471968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 63/115] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.471968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.523887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.524809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.525120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.525945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.538989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:34.547725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:34.548711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:34.549438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 53/116] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:34.550056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.614670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4449ea-50cc-45da-8af1-26fce61d8248 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.625674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.651758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.652626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.652913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.653195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.663734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:34.669480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd788-6933-4cf5-a83e-ebcdcf8896ce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:34.672305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:34.673285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:34.674040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 64/117] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:34.674637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.709583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.710601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.710988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.711381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.712677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.714146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.716195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 54/118] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.721540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.724478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.782942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1e39-ea1d-49a3-be74-39d128caa002 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.817125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.817999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.818285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.818566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.819753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.821269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409047db-6b87-4757-965e-687bcd07c4ed None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.823078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 65/119] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.824260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9960-aebf-4fc1-adbb-3c2273e01c60 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.824597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9960-aebf-4fc1-adbb-3c2273e01c60 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.824858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9960-aebf-4fc1-adbb-3c2273e01c60 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.828595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 66/120] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:34.828595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9960-aebf-4fc1-adbb-3c2273e01c60 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.836415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3bb5-4d88-411b-ac43-f90b9aa3bcd4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.863231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.871640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.872402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.872729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.873015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.873769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:34.874083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.875470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.883994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 55/121] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:34.887808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:34.947865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9960-aebf-4fc1-adbb-3c2273e01c60 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:34.959810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:34.985318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:34.986103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:34.986284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:34.986560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:34.987317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:34.987632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:34.989068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:34.993681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef7c6-99a6-4ba1-a5cc-87648913fe6c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.002705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 67/122] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:35.003350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.035714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.036642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.050098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.050098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.050098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:35.050098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95aaa1-0c27-48d6-88fb-3cf615ba5f84 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:35.101016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57375aa-f112-43b2-bc52-e65ca3033e35 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.133711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.135169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.135451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.135726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/cbbc2703cf604866b1601e5d461198e6/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.137960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, user_id=cbbc2703cf604866b1601e5d461198e6, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:35.139401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:35.260757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 56/123] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:34 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:35.262833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.263126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.263409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.287572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:35.288855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:35.301895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 68/124] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:35 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/cbbc2703cf604866b1601e5d461198e6/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:35.303482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.352893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:35.384249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:35.437627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 57/125] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:35.438367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.510255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe95b-50a0-479b-bec4-1df262fcb234 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.564141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.565502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.566266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.566787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] PATH_INFO: `/v3/users/e8844bc55bf24af8bb553113bd505659` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.589665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=e8844bc55bf24af8bb553113bd505659)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:35.590145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31063-344a-4573-8981-f53bc93f0f5a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.592097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:35.594949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 69/126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:35 2022] GET /identity/v3/users/e8844bc55bf24af8bb553113bd505659 => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:35.595919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.638112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.639003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.639294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.639573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.641044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:35.642618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:35.644291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 58/127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:35 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:35.649624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.734355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:35.754817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:35.772986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fb83-80f2-49c5-b40e-5027974ebbe8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.829873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434307d3-d1bb-4957-86fe-a1c75cccfaa6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:35.840610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.841537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.841833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.842117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:35.861057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:35.875567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:35.876453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:35.877221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:35.878898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 70/128] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:35.881801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:35.916872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:35.917592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:35.917885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:35.918166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.011380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.013505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.065408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:36.130183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f857-8fdd-4e01-83f3-11379cd3ebd0 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.175087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.176209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.176664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.177083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.179505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.183301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 59/129] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:36.185021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.186944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 71/130] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:35 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:36.187976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.189341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.228784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:36.361423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836e2c-9557-432e-b051-7bf3e43620e4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.405245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.405970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.406257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.406530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.407280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:36.407585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.408684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9406207-c273-4883-8a74-a5a1aa66dc26 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.409117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.424695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 60/131] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:36.424695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.437529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:36.490586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.491804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.492229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.492693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.494458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.503307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.503307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 72/132] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:36 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:36.504068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.545630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d67e7-3aa1-46cb-adf4-e5bb994adaca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.585038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.586186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.586474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.586761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.590560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e, role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.592217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.674857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:36.696758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 61/133] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:36 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/b5c3b136cc84423fb874b4d72253033e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:36.697915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.704154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae79e4c-274b-4836-bca1-85b760fb06fe None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.772858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.774131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.774636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.775179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.776654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.778385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1e7c3-d4b3-4d0e-a352-3f7ada586a52 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.780722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 73/134] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:36 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:36.782272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2eb5-4d2e-46cb-980c-b14018986893 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.782758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2eb5-4d2e-46cb-980c-b14018986893 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.783251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2eb5-4d2e-46cb-980c-b14018986893 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.785150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 74/135] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:36.791230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2eb5-4d2e-46cb-980c-b14018986893 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:36.803322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:36.848373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3cd53-63e7-48a2-878f-75b600d7a4a8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:36.907302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:36.907978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.908266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.908568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.912447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=e8844bc55bf24af8bb553113bd505659) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:36.913512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:36.914755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db663-3087-492c-8eb6-9b694feee493 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:36.936671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 62/136] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:36 2022] GET /identity/v3/role_assignments?user.id=e8844bc55bf24af8bb553113bd505659&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:36.938275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:36.938587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:36.938880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:36.974664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:36.977485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:37.038921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2eb5-4d2e-46cb-980c-b14018986893 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:37.073825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 63/137] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:37.102659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:37.104955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:37.105405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:37.105839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] PATH_INFO: `/v3/projects/bfbd696121a04c6fb6e856fb82b9d836` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:37.107498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=bfbd696121a04c6fb6e856fb82b9d836)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:37.109255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:37.111336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 75/138] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:36 2022] GET /identity/v3/projects/bfbd696121a04c6fb6e856fb82b9d836 => generated 312 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:37.117585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:37.132143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:37.175203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:37.241882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:37.271503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0cd9-f40d-42ae-9304-856fc992b1b2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:37.309187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3f5b-e81b-4517-bd16-7785e8979931 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:37.322070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:37.322676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:37.323026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:37.323312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:37.325977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:37.327465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:37.329149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 76/139] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:37.334751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:37.364361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:37.365311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:37.365602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:37.365880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] PATH_INFO: `/v3/projects/bfbd696121a04c6fb6e856fb82b9d836/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:37.369476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfbd696121a04c6fb6e856fb82b9d836, user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:37.370939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639664-122f-411c-a751-e35bcfa5af62 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:37.463227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 64/140] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:37 2022] PUT /identity/v3/projects/bfbd696121a04c6fb6e856fb82b9d836/users/9bb8cdd31f274fcfb5a0da55b7e0d32e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:15:37.491034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:37.503924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda45-83e2-4862-ad1c-b0d1816fa767 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:37.553209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:37.553907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:37.554194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:37.554476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:37.555207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:37.557368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1fef5-bc67-4d56-a823-c81c3145dde8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:37.691469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 77/141] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:37 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:37.991432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13a93-721b-4908-8060-6046f42fc94e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:37.991750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13a93-721b-4908-8060-6046f42fc94e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:37.992008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13a93-721b-4908-8060-6046f42fc94e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:37.993449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 65/142] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:38.000150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159e94-4079-4bae-b725-7540cbd5c166 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.000445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159e94-4079-4bae-b725-7540cbd5c166 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.000771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159e94-4079-4bae-b725-7540cbd5c166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.021663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ed159e94-4079-4bae-b725-7540cbd5c166 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:38.022881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ed159e94-4079-4bae-b725-7540cbd5c166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:38.105277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 78/143] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:38.141335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d13a93-721b-4908-8060-6046f42fc94e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.178003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d6da-2f63-486c-99ac-ac933a7ae4d5 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.178274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d6da-2f63-486c-99ac-ac933a7ae4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.178480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d6da-2f63-486c-99ac-ac933a7ae4d5 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.180136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 79/144] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:38.187070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.187356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.187637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.217505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:38.218690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:38.308304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d13a93-721b-4908-8060-6046f42fc94e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:38.309529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 80/145] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:38.335440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.345821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:38.365020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:38.388129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:38.389208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.389496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.389770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.413368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:38.428325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:38.429206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:38.429946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:38.430880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 66/146] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:38.437433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.515790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2abf-e88f-4de6-818b-09e223bc8abc None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:38.561442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:38.562524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.562804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.563073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.578410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:38.589133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:38.590008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:38.590749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 81/147] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:38.597443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.648871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b643fe-e133-4f55-9df3-0b21aed6383b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:38.678860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:38.716766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:38.717570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.717865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.718146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.718911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:38.719226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:38.720642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:38.721096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accb4e5-f0bb-4493-a1ed-f9db0266a1f3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:38.734921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 67/148] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:38.741464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.777243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:38.779499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.779938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.780412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.783938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:38.784400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:38.785972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:38.803278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 82/149] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:38.827227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:38.840621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:38.921191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2780f-7f8f-49fb-94f4-3cb7ce4cbef0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:38.965174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:38.966383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:38.966855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:38.967336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:38.968772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:38.970423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:38.972253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 68/150] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:38.977873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:39.017034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8d31-7a49-4660-8d5e-d4302437bfc3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.060915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.070476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.071087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.071371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.072415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] PATH_INFO: `/v3/users/cbbc2703cf604866b1601e5d461198e6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.077232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbc2703cf604866b1601e5d461198e6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.078810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.080421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 83/151] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/users/cbbc2703cf604866b1601e5d461198e6 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:39.085791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:39.092537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d120f-9f37-4e01-9413-be95d3fa71ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.106683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.129183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.130098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.130516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.130952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.207957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.209867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.241519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff29ad-9b10-4e9c-8d36-2df0615328c8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.305777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.306574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.306859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.307137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.326067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 69/152] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:39.332227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:39.384632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.393936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.404004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.405531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.444820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecbb06-7370-4d03-9b94-23daaa4588be None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.485457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.486415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.486831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.487116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.488856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.490318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.492382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 70/153] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:39 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:39.500259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:39.590967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.624306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae03d3-1d2e-4c55-ae3f-24b191e17517 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.636107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 84/154] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:39.641712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:39.667282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.667957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.668243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.668538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.669388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:39.669815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.671295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.683029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 71/155] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:39 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:39.819669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:39.825844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878823fa-1102-471a-a276-59aeda3f3df8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:39.868098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:39.869287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:39.869575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:39.869854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:39.877511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:39.879041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962d745-e3fa-446f-aff5-5ab5174db14f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:39.881236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 85/156] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:39 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:39.887580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:40.047451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5957a5-fa44-4fdf-804a-18b2abd093d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:40.093107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:40.093820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.094104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.094379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.095223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=cbbc2703cf604866b1601e5d461198e6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:40.095533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:40.097053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04f3e-ce38-453a-b48f-9025433e479c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:40.108150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 72/157] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:39 2022] GET /identity/v3/role_assignments?user.id=cbbc2703cf604866b1601e5d461198e6&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:40.257737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261a95-c8b9-46cb-8bf3-79ce52844770 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.258098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261a95-c8b9-46cb-8bf3-79ce52844770 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.258295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261a95-c8b9-46cb-8bf3-79ce52844770 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.260352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 86/158] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:40.266800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.267398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.267871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.293440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:40.294993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:40.297498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:40.348056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693a76-e27e-494f-9068-c4af50ade72d None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.348329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693a76-e27e-494f-9068-c4af50ade72d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.348548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693a76-e27e-494f-9068-c4af50ade72d None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.350104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 87/159] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:40.359386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.359701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.359949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.389192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:40.390421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:40.424660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 73/160] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:40.482175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:40.497623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 88/161] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:40.551123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:40.637705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c957-9904-4ef6-81a6-4901b2af9767 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:40.698309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:40.704118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9fab-33f2-4bed-b03e-ff943b5097aa None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:40.729409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:40.730249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.730532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.730807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.745643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:40.746724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.747011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.747324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.751572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:40.764685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:40.765759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:40.777063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:40.777978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:40.779205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 89/162] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:40.781905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:40.782742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:40.784745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 74/163] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:40.796815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:40.797066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:40.928461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ff5f0-eaea-4396-92a7-7ba567daec24 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:40.965723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:40.966579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:40.966875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:40.967158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:40.967925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:40.968235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:40.969694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:40.979828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 90/164] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:40.985856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.012922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:41.095798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c45b-2608-4a92-9f7c-f5d6ee0e6f44 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.101611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca987-22cc-4bdb-bbbe-7f2c5345eab4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.131998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.137390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.137689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.137966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.139370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.140859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.142725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 91/165] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:40 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:41.149020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.167413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.168008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.168288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.168591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.169349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:41.169654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.171670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.181825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 75/166] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:41.189803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.312274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:41.314408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:41.357538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b61-b360-467b-a809-7f10a91f9edf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.396459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aeb4a-9a91-497f-9f3e-ce0e321087c6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.417696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.418274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.418562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.419050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.466101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.466980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.467261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.467532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] PATH_INFO: `/v3/users/e8844bc55bf24af8bb553113bd505659` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.469666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] RBAC: Authorizing `identity:get_user(user_id=e8844bc55bf24af8bb553113bd505659)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.471318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.474133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 76/167] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:41 2022] GET /identity/v3/users/e8844bc55bf24af8bb553113bd505659 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:41.481191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.573557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.575435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0a8e-22f6-45fa-9975-9c67872bd387 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.697538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497c2c-10e6-4ec1-bb8c-ecbbc334fb4a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.717222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:41.733396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 92/168] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:41.735062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f3cf-a7ae-4b82-b584-db134646b91a None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.735489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f3cf-a7ae-4b82-b584-db134646b91a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.735904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f3cf-a7ae-4b82-b584-db134646b91a None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.737356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 93/169] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:41.739212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f3cf-a7ae-4b82-b584-db134646b91a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.758248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:41.774851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.776095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.776381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.776716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.777967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.779416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7ee2c-eaf5-4f6e-adac-9beb9df2b3c0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.789448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 77/170] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:41 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:41.791167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.791507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.791783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.833543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:41.834744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:41.850243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f3cf-a7ae-4b82-b584-db134646b91a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:41.888240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:41.889581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:41.890232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:41.890705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:41.892104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:41.893799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:41.899607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 94/171] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:41 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:41.906949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:41.968979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:42.023164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046bc61-e7db-4240-bcff-c9952b2edb58 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:42.061736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:42.062993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.063435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.063870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/e8844bc55bf24af8bb553113bd505659/roles/a81f50697b1f42eeb332b2a684e18008` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.066435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, user_id=e8844bc55bf24af8bb553113bd505659, role_id=a81f50697b1f42eeb332b2a684e18008)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:42.068199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:42.088148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 78/172] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:42.089431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.164826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 95/173] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:41 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/users/e8844bc55bf24af8bb553113bd505659/roles/a81f50697b1f42eeb332b2a684e18008 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:42.166569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.391447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4091-7803-4b12-8717-476633cf3d68 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:42.398811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87f7e-9558-47ca-ae1d-5b95de08c269 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:42.418974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:42.467443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:42.467948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:42.468714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.468910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.469157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.474831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:42.475509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.475793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.479903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.479903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:42.479903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:42.479903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2d98c-f39f-496a-a806-ce19ca82ad5d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:42.486867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 79/174] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=b5c3b136cc84423fb874b4d72253033e => generated 608 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:42.488706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0590-420b-4d00-81ed-af5fe9ce9828 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.489142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0590-420b-4d00-81ed-af5fe9ce9828 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.489561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0590-420b-4d00-81ed-af5fe9ce9828 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.490874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:42.491809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 80/175] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:42.497921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9304-7aae-4b35-98e9-5d99baf524b5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.498517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9304-7aae-4b35-98e9-5d99baf524b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.498936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9304-7aae-4b35-98e9-5d99baf524b5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ef6afc8b-08aa-4b25-aed6-278acbfaa1c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:42.499495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:42.500609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:42.501395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:42.503454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 96/176] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:42.504158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 81/177] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:42.509584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.509866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.510084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc14d-b583-4796-9b2e-9a96ba385017 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.514382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.514517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc14d-b583-4796-9b2e-9a96ba385017 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.514517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc14d-b583-4796-9b2e-9a96ba385017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.528559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:42.530257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:42.544647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-340dc14d-b583-4796-9b2e-9a96ba385017 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:42.546359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-340dc14d-b583-4796-9b2e-9a96ba385017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:42.646033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 97/178] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:42.646671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.654667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 82/179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:42.656132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09acf5-3c0e-432a-a7ef-a4f3f88c94af None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.656429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09acf5-3c0e-432a-a7ef-a4f3f88c94af None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.656733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09acf5-3c0e-432a-a7ef-a4f3f88c94af None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.658107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 83/180] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:42.663783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.664068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.664350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.692687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:42.694408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:42.776923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 84/181] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:42.778293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.782634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576fc2e-a3d7-4691-8cf8-1049f25a9116 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:42.784891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:42.834918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:42.836274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.836887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.837699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.839163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:42.839753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:42.842006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:42.842112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:42.851337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 98/182] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:42.856893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.903079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de2ff-0580-41f3-b921-9d93213f855d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:42.939675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:42.940500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:42.940805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:42.941082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:42.951787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:42.959966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:42.960869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 85/183] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:42.967408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:42.974984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cdcc1-e1a0-47bf-8abf-83904a2031aa None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.013873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.014790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.015079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.015355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.026884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:43.034709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:43.035747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:43.036993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 99/184] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:43.041932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.068614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b305ab9-ce3e-4f11-9b82-b45258169917 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.069761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.082476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.106922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.107730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.108015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.108297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.109531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.110999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.112660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 86/185] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.113425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.151001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b959eac-48bb-40a5-b3ae-8cd7339740d3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.184894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.185691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.185982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.186256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] PATH_INFO: `/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.187476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb8cdd31f274fcfb5a0da55b7e0d32e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.188995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.190669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 100/186] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/users/9bb8cdd31f274fcfb5a0da55b7e0d32e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.191441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.227265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc9d0f-acfb-4f82-879c-e28ab1f9c1e3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.263139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.263840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.264136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.264399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.265178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:43.265486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.266993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.276001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 87/187] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.276884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.293673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.310287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794a8f-0f18-451b-8e83-692121edfb88 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.322974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.351167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.351885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.352482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.353937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.354696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:43.355003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.356390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.366196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 101/188] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.371805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.382821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03b2a-a595-457b-a1ca-61917786dbfe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.421552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.422523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.422979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.423548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.424573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.426253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.474144 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800695d-8878-44fe-ab74-35eefb32342f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.507753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.508419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.508737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.509681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.536361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.553368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 88/189] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:43 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:43.554902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.600953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.603540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.680746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.688749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0691f5-a1d4-4e9f-b73b-3ead28c991ea None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.728476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.729418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.729706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.730014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.735043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 102/190] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:43.736127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.750420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.752459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.754810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 89/191] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.755818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.806598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:43.868074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4818-7f7b-4709-8984-c074e61e235a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.879719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1cb4-cd36-4c89-a7fc-dfa549900121 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:43.912305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.913229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.913519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.913802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.916172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.917124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.918804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 103/192] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.923873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.930222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:43.931827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:43.932666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:43.933437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] PATH_INFO: `/v3/projects/bfbd696121a04c6fb6e856fb82b9d836` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:43.935460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=bfbd696121a04c6fb6e856fb82b9d836)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:43.936980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:43.939196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 90/193] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/projects/bfbd696121a04c6fb6e856fb82b9d836 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:43.939833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:43.987961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.076410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca52e3-5e8e-4b5b-bae9-e348a5e0a295 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.080138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ae7ff-ad1a-4e04-b93b-be5d056b2ca7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.121992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:44.122656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.122936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.123208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.129296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.158128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:44.158793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.159074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.159349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.244146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:44.245658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:44.284849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.285033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:44.286449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:44.413659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 91/194] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:44.414519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:44.467625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 104/195] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:44.468480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:44.497102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.613021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a0e6-b1d6-4117-98af-adc66b973905 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.619016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99644273-eec2-489c-b557-8a020c672c72 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.666841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.685422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:44.686301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.686582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.686856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.689109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:44.690559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:44.692423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 105/196] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:44 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:44.693055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:44.695055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:44.695716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.695997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.696325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.697879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=bfbd696121a04c6fb6e856fb82b9d836, user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:44.698055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:44.699465 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abaff3-8d35-448c-851a-80749f24ab7c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:44.712518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 92/197] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:44 2022] GET /identity/v3/role_assignments?user.id=9bb8cdd31f274fcfb5a0da55b7e0d32e&scope.project.id=bfbd696121a04c6fb6e856fb82b9d836&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:44.712518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185963e-b42d-470e-aa5f-ec3570d2a718 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.712518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185963e-b42d-470e-aa5f-ec3570d2a718 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.712518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185963e-b42d-470e-aa5f-ec3570d2a718 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.721386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 93/198] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:44 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:44.722115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185963e-b42d-470e-aa5f-ec3570d2a718 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:44.813345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:44.826161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6a5b-373e-4170-898e-8c3a66cebbd0 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.867850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:44.869441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.869727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.870005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.871377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:44.872880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf52bca-e7da-4b8d-8326-2c7a64fea714 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:44.875548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 106/199] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:44 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:44.877485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:44.877779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:44.878058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:44.902122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:44.903414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:44.982349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185963e-b42d-470e-aa5f-ec3570d2a718 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:44.990309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 107/200] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:44.991247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:45.021608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.022277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.022624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.022899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:45.023743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=82f9214597974ad9b45801eadcda7765) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:45.024055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:45.025831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:45.032881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 94/201] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:44 2022] GET /identity/v3/role_assignments?user.id=82f9214597974ad9b45801eadcda7765&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:45.039092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:45.138215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:45.150626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:45.174183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75081-cb71-42e7-bde3-635f49335451 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:45.235009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69152b62-206e-4261-8474-f25e704972b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:45.244817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.245503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.245790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.246071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:45.246929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=82f9214597974ad9b45801eadcda7765) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:45.247244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:45.249120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:45.262887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 108/202] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:44 2022] GET /identity/v3/role_assignments?user.id=82f9214597974ad9b45801eadcda7765&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=b5c3b136cc84423fb874b4d72253033e => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:45.284972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.286158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.286616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.287058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:45.302099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:45.312584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:45.313536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:45.314314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:45.316799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 95/203] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:45.322980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:45.448540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2275-fe8b-46bf-83e7-398b050b8e56 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:45.494026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.494722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.495006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.495284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:45.496054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:45.496363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:45.497808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:45.511874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 109/204] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:45.517538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:45.641611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ee6f-a0e0-4807-b07d-8372bcba1151 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:45.656411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:45.692650 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.693769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.694201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.694619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] PATH_INFO: `/v3/users/e8844bc55bf24af8bb553113bd505659` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:45.696030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] RBAC: Authorizing `identity:get_user(user_id=e8844bc55bf24af8bb553113bd505659)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:45.698193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:45.701132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 96/205] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:45 2022] GET /identity/v3/users/e8844bc55bf24af8bb553113bd505659 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:45.705589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:45.749284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:45.863164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1007-df81-4518-9dd0-86391cd9888d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:45.922457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:45.923128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:45.923414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:45.923691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.016083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:46.017553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:46.040223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:46.169371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 110/206] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:46.175869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:46.315098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9ad-5ff2-49b6-a574-41c5af9ca20d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:46.363095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:46.364022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.364307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.364607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.365854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:46.367329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c312a-ee7b-4340-a339-0c27a0456b0f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:46.369614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 97/207] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:46 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:46.375583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:46.513382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3980afa-57d1-4387-ac5a-af378e05745d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:46.533613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:46.546926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524728d4-af93-4941-805c-f0b3a47add27 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.547218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524728d4-af93-4941-805c-f0b3a47add27 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.547503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524728d4-af93-4941-805c-f0b3a47add27 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.549271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 98/208] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:46.555600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.556451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.556760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.558706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:46.559437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.559666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.560140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.560818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, scope.project.id=6dd8667bcb0145f5a24c5dded225829f, user.id=e8844bc55bf24af8bb553113bd505659) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:46.561132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:46.562601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36284df5-f1e0-45d0-9a0d-22ba144fdc1f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:46.569335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 111/209] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:46 2022] GET /identity/v3/role_assignments?user.id=e8844bc55bf24af8bb553113bd505659&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:46.570604 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b956-3cd3-4e9f-9457-fbdf358bec9d None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.570893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b956-3cd3-4e9f-9457-fbdf358bec9d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.571215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b956-3cd3-4e9f-9457-fbdf358bec9d None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.572858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 112/210] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:46.578233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.578550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.578785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.581294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:46.582634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:46.597262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:46.599257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:46.673823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:46.703937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 113/211] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:46.717159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 99/212] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:46.732127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:46.763219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:46.871647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2bef-2cf4-4d5c-a077-e0c1840d6886 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:46.882157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:46.895833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031310d-12ac-4166-9c5b-c024df8b2aaa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:46.912307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:46.914165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.914748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.915942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.926686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:46.936123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:46.937205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:46.937976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 114/213] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:46.944524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:46.944524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:46.944524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:46.944524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:46.944851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:46.947193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:46.947860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:46.949537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 100/214] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:46.955899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:47.017192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:47.067435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f74c2-d426-4496-b443-82b4d0e67ebc None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:47.089345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df58d8-ea4d-4690-aa3f-06518a300384 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:47.109410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:47.110093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.110380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.110694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.111415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:47.111727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:47.113498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:47.125672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 115/215] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:47.130900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:47.133448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:47.135062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.136345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.137080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.137972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:47.139604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:47.166286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:47.237429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3e236-68ab-41e9-86f6-6458d5909154 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:47.271813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:47.272836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.273175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.273456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] PATH_INFO: `/v3/users/afe8ed5fdef6421e8e7ba03012836d26` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.287003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] RBAC: Authorizing `identity:get_user(user_id=afe8ed5fdef6421e8e7ba03012836d26)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:47.288498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:47.291099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 116/216] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:47 2022] GET /identity/v3/users/afe8ed5fdef6421e8e7ba03012836d26 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:47.296247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:47.302168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 101/217] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:46 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:15:47.424663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:47.438689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d247b6-c9f8-42c5-a50a-6245cc789a1b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:47.478256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:47.478978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.479260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.479534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.553607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:47.555072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6914cf-c2dc-45e7-9600-d5ed923dba3c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:47.659775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:47.676394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 117/218] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:47.684181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:47.685442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbce2d-c211-4f85-9141-37945102bf94 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.685949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbce2d-c211-4f85-9141-37945102bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.686492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbce2d-c211-4f85-9141-37945102bf94 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.688314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 118/219] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:47.703838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f35d1-1932-4f52-9d63-b3f06f44013b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.704128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f35d1-1932-4f52-9d63-b3f06f44013b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.704397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f35d1-1932-4f52-9d63-b3f06f44013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.731359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-165f35d1-1932-4f52-9d63-b3f06f44013b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:47.732637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-165f35d1-1932-4f52-9d63-b3f06f44013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:47.817062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:47.822460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03cf32-32ac-48d6-bb51-b7a5712637e2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:47.864649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:47.865906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.866390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.866862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.868848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:47.870175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 119/220] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:47.870776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:47.877308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 102/221] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:47 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:47.881690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b3f5-4392-4ced-b20f-84b0fbeb5b2b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.882134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b3f5-4392-4ced-b20f-84b0fbeb5b2b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.882230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b3f5-4392-4ced-b20f-84b0fbeb5b2b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.884285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 120/222] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:47.888622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:47.901821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:47.902330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:47.902754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:47.931619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:47.932854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:48.015065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529db39-d9b4-4012-8578-2ad6858a6dcc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.029227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 121/223] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:48.033470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.079572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.080413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.080750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.081023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.082164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=afe8ed5fdef6421e8e7ba03012836d26) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:48.082777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.084411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.090262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:48.091931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 103/224] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:47 2022] GET /identity/v3/role_assignments?user.id=afe8ed5fdef6421e8e7ba03012836d26&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:48.096659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.168901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:48.213800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc03e-0f39-4ac3-9d15-34947af6786b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.287525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.288342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.288661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.288936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.311984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6e3d-095b-4571-9273-6a24ae27e6ec None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.314155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:48.329069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:48.329994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:48.330779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:48.337761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 122/225] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:48.341775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.376326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.377194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.377471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.377740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.395114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:48.414903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:48.416319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:48.417123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:48.418903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 104/226] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:48.423635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.508838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394087-bd89-4ac5-8b74-f9eb4966449c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.519166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:48.547939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.548780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.549065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.549340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.550341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:48.550647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.552461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.562660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 123/227] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:48.570302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.622162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:48.639191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8029e2-9729-40f6-a6bb-fcf283100c88 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.698540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.699335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.699569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.699853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.700660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:48.700973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.702398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.702748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff98c0-63ed-449a-a0ef-691bc4770627 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.724962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 105/228] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:48.725950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.741746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.742658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.743660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.744124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.747667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.750739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.754198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 124/229] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:48.760434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.836696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:48.899751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3de5e-c06f-4f2a-9a67-aaf653ea6003 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.915972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfaa6-c25b-45d3-93a4-37a62196f87f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:48.943335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.944680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.945159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.945627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.947201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.956509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:48.956509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:48.956509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:48.956509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:48.956828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:48.956828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.957698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:48.958261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 125/230] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:48.959761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 106/231] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:48.968221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:48.968376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:49.010373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:49.072712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13570ff-6765-4d02-afd7-7d4edb9e7581 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:49.080274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:49.108976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:49.109839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:49.110115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:49.110383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:49.116510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:49.116510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:49.116510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 126/232] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:48 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:49.121035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:49.206462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ccae-f014-4490-9de7-e7df6601ab5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:49.226893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54973-0588-4fad-a6b4-8af962aeb376 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:49.264605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:49.265555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:49.265834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:49.266108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/users/82f9214597974ad9b45801eadcda7765/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:49.268861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, user_id=82f9214597974ad9b45801eadcda7765, role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:49.270455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0b353-3f39-4e8b-8edd-b53fa286668d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:49.299423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:49.300709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:49.301220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:49.301666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/users/82f9214597974ad9b45801eadcda7765/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:49.303956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, user_id=82f9214597974ad9b45801eadcda7765, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:49.305720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6549-fc24-4dcf-a2a1-dbd914288f79 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:49.361847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 127/233] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:49 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/users/82f9214597974ad9b45801eadcda7765/roles/b5c3b136cc84423fb874b4d72253033e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:15:49.405875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 107/234] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:48 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/users/82f9214597974ad9b45801eadcda7765/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:15:49.999545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb4c0-1e6e-46cc-85bd-b8ac899abdf2 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.000038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb4c0-1e6e-46cc-85bd-b8ac899abdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.000111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb4c0-1e6e-46cc-85bd-b8ac899abdf2 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.001786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 128/235] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:50.010838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.011897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.012390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.026810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ae72-82f9-41a4-a6fc-95b3f62f5fc7 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.027155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ae72-82f9-41a4-a6fc-95b3f62f5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.027503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ae72-82f9-41a4-a6fc-95b3f62f5fc7 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.029795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 129/236] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:50.034673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.035003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.035323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.036252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:50.037692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:50.068472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:50.069936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:50.112267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 108/237] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:50.132879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.138242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.180999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.198786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 130/238] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:50.234052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.240176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc2cd3-5f3b-471e-b451-33156dc27477 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:50.276019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:50.276904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.277181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.277454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.278663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:50.280110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:50.281783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 109/239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:50.290298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.378949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.398893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2a040-be4c-4c3c-9758-92a4f798cfbf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:50.434825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:50.435413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.435736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.436013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.436759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:50.438212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:50.470267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c3c4-e73e-41be-9801-16e925c2ca05 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:50.507562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:50.508387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.508713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.508992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.520278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:50.528953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:50.529802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:50.530726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 131/240] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:50.536052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.565194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 110/241] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:50 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:15:50.572852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.679899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1b6b-f343-4d3e-bdf5-c0b2afb3782b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:50.736366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:50.737003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.737287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.737566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.738333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:50.738643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:50.740060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ef740-f03a-4ad5-9656-90aa5fa7d88e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:50.750568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 132/242] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:50.756349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.791410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d847fd-3bab-4555-9581-9a8ab99cbf03 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.791737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d847fd-3bab-4555-9581-9a8ab99cbf03 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.791984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d847fd-3bab-4555-9581-9a8ab99cbf03 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.793416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 133/243] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:50.799621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.799908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.800174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.831091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:50.831283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:50.917761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599dd11-edd5-4d5b-974f-9a9615ad0d99 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:50.927676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 134/244] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:50.955539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:50.956602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:50.956955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:50.957298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] PATH_INFO: `/v3/users/34e6111da23043f88d54920adcec02fb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:50.960334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:50.963431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.980856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] RBAC: Authorizing `identity:get_user(user_id=34e6111da23043f88d54920adcec02fb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:50.982237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:50.982531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:50.984457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 111/245] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/users/34e6111da23043f88d54920adcec02fb => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:50.990476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.098529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fcfa2-14fb-45c1-9256-98914192f1e5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.120593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8605a-4d06-40cc-a682-7da4ebcb3a88 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.177787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.178986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.179451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.179948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.187605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.188340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.188725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.189070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.197649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:51.207589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:51.208454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:51.209357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:51.212244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 135/246] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:51.218033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.254527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:51.263261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.264864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.303984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:51.327946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a33d-7b7b-4804-980f-cac3eb849286 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.378049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.379595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.380086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.380555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.381512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:51.381992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.382173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 112/247] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:51.383780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.390373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.397788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 136/248] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:51.405099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.527133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:51.541935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b219709-fe1f-4987-8a37-4d2bb316e83d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.573068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07640982-109f-49d2-80a7-e8c7c980eccc None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.619107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.620163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.620452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.620801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.622189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.624723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.626944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 113/249] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:51 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:51.633125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.658182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.659371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.659916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.660365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] PATH_INFO: `/v3/users/afe8ed5fdef6421e8e7ba03012836d26` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.661784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] RBAC: Authorizing `identity:get_user(user_id=afe8ed5fdef6421e8e7ba03012836d26)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.663410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.672721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 137/250] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:51 2022] GET /identity/v3/users/afe8ed5fdef6421e8e7ba03012836d26 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:51.693550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:51.716033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:51.801663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1509-bd16-4c59-8ced-5fb772d3b413 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.866392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.867068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.867348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.867649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.869307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=34e6111da23043f88d54920adcec02fb) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:51.869414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.870811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.881236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 114/251] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:51 2022] GET /identity/v3/role_assignments?user.id=34e6111da23043f88d54920adcec02fb&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:51.905879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167642-299a-407d-9fc1-9d8935eefe0b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:51.949334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:51.950218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:51.950495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:51.950767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:51.954281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:51.955797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354c5be-ddf6-4258-bf8a-472a29c4212d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:51.957770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 138/252] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:51 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:51.964238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:52.032931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:52.105814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225c58-0325-4fd5-9b3d-17cf1f7be78b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:52.148003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:52.149031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.149396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.149673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/users/afe8ed5fdef6421e8e7ba03012836d26/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.151834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, user_id=afe8ed5fdef6421e8e7ba03012836d26, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:52.153394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:52.189630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a579-7a64-420c-8a6f-a1d559c2672d None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.190163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a579-7a64-420c-8a6f-a1d559c2672d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.190163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a579-7a64-420c-8a6f-a1d559c2672d None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.192015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 139/253] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:52.197818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682e84-beea-48c6-89b4-d192017dc833 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.198098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682e84-beea-48c6-89b4-d192017dc833 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.198386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682e84-beea-48c6-89b4-d192017dc833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.222060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-57682e84-beea-48c6-89b4-d192017dc833 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:52.222579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-57682e84-beea-48c6-89b4-d192017dc833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:52.232030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 115/254] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:51 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/users/afe8ed5fdef6421e8e7ba03012836d26/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:52.317934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 140/255] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:52.363657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:52.471182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:52.491801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ba83-ae39-4e93-8f3a-3194685f9b13 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:52.494240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b5e-651b-47a4-a896-894e998a74fb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.494527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b5e-651b-47a4-a896-894e998a74fb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.494814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b5e-651b-47a4-a896-894e998a74fb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.496363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 141/256] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:52.501055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.501342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.501620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.510539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:52.535352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:52.536928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:52.542235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:52.542412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.542683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.542960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.554177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:52.562662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:52.563634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:52.564428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 116/257] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:52.569755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:52.677008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001cba-8e19-4318-94e9-6710ceeacc8b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:52.701842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 142/258] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:52.718673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:52.719355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:52.719640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:52.719917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:52.720769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:52.721080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:52.722550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:52.726426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:52.738630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 117/259] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:15:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:52.745025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:52.768708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:52.960202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1032f-6a70-4392-a45c-ffa3c7df04a5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:52.998664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf91b-9bf8-4b9d-ab83-d1256ed3f5f1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:53.016283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.017129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.017413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.017712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.020787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:53.032667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:53.044871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:53.045788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:53.047029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 143/260] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:53.051782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:53.089460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.090336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.090613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.090883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.092082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:53.093562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:53.100918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 118/261] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:52 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:53.113487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:53.225221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b192a8-638e-40a5-8e28-085a0b72d062 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:53.298025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.299139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.299621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.300101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.301131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:53.301660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:53.303877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:53.321158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 144/262] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:53.326979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:53.358718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:53.413555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034bd0a-b25a-4b84-9742-1fe78e2a58fd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:53.422850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:53.494139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15072-f292-458c-bf5f-8a99f9af5896 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:53.496041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.496902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.497329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.497752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.554946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.556613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.557050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.557577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] PATH_INFO: `/v3/users/82f9214597974ad9b45801eadcda7765` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.562870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] RBAC: Authorizing `identity:get_user(user_id=82f9214597974ad9b45801eadcda7765)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:53.564721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:53.567176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 145/263] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:53 2022] GET /identity/v3/users/82f9214597974ad9b45801eadcda7765 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:53.572067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:53.669551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:53.671022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:53.746683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f440b-ef4b-46a5-bded-259d0a913315 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:53.800843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:53.820657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:53.821885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:53.822700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:53.822991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:53.870390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:53.915238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 119/264] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:53.921541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.027364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:54.028859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b3b1f-0e3b-401b-aa21-701309a8e5f7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:54.072598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7370e-c176-4983-8e8c-3aebc6a45f70 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.111157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:54.112358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.112890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.113358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.114994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:54.117135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65bda0-b868-4365-9487-c0c14169ad9b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:54.119993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 120/265] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:53 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:54.126247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b4c6-5102-4cc2-801c-9d7c7d5d1975 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.126927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b4c6-5102-4cc2-801c-9d7c7d5d1975 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.131403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b4c6-5102-4cc2-801c-9d7c7d5d1975 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.131403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 121/266] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:54.131403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b4c6-5102-4cc2-801c-9d7c7d5d1975 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.229259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:54.303629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 146/267] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:15:54.304913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20270-473e-46d3-beaa-bbe7c32a1075 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.305260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20270-473e-46d3-beaa-bbe7c32a1075 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.305740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20270-473e-46d3-beaa-bbe7c32a1075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.330429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b4c6-5102-4cc2-801c-9d7c7d5d1975 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.333728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-bfb20270-473e-46d3-beaa-bbe7c32a1075 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:54.334938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bfb20270-473e-46d3-beaa-bbe7c32a1075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:54.358248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:54.374031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:54.375490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.375946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.376352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.377464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=82f9214597974ad9b45801eadcda7765) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:54.377968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:54.380582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:54.393272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 122/268] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/role_assignments?user.id=82f9214597974ad9b45801eadcda7765&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=b5c3b136cc84423fb874b4d72253033e => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:54.395810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.452089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 147/269] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:54.453498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3c2e-aed2-4a92-9214-137a236941f4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.453782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3c2e-aed2-4a92-9214-137a236941f4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.454055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3c2e-aed2-4a92-9214-137a236941f4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.455440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 148/270] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:54.462589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.462903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.466426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.502875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:54.504071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:54.622421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7d9b-da6f-429c-875a-d5b6604c9efe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.634765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:54.636761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 149/271] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:54.637727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.676162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:54.677598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.678078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.678561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.680719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:54.682497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:54.684591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 123/272] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:54.691675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.728048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:54.747145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2560cf-bb36-4192-aa22-d84ec89ce854 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.786124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:54.786932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.787212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.787509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.802437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:54.811364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:54.812482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:54.813311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:54.813914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 150/273] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:54.815472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.830461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5934b-baba-46e1-a51f-ab1e3827b62d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.869667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:54.870328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:54.870613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:54.870892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:54.871792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=82f9214597974ad9b45801eadcda7765) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:54.872133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:54.873740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:54.880036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 124/274] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/role_assignments?user.id=82f9214597974ad9b45801eadcda7765&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:54.880895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:54.931770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:54.998589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b15f4-be61-467a-ba70-4d5d83e1b8e9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:54.999032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4a3b9-7254-413d-95eb-7e14d19d1f4d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.037895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.038576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.039046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.040077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.041213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:55.041800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.043515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.054136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 125/275] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:55.062209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.085480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.086896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.087191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.087551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.090864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.092546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.094710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 151/276] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:55.101403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.119171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.199435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4412d1-85d7-4ae6-b351-6b9f3d47dfcb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.201174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.217545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eec45-1262-47e2-98d6-54f43daef7c1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.237805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.239125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.239713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.239987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] PATH_INFO: `/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.251420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026416-1130-4109-be51-4f721006b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.252092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026416-1130-4109-be51-4f721006b542 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.252374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026416-1130-4109-be51-4f721006b542 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.252686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026416-1130-4109-be51-4f721006b542 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.253403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026416-1130-4109-be51-4f721006b542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.253833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] RBAC: Authorizing `identity:get_user(user_id=ba5aa7a738634dbea51bfd4e95d4b75d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.254849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026416-1130-4109-be51-4f721006b542 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.255277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700d68-18d3-4dc1-a8c4-c2ccf3bd85ae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.256972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 126/277] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:55.258290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df20a-334a-4311-8c16-c4de7c087e14 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.258569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df20a-334a-4311-8c16-c4de7c087e14 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.258839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df20a-334a-4311-8c16-c4de7c087e14 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.260220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 127/278] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:55.265302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48995-3756-412c-a737-b8e7de63f99c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.265592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48995-3756-412c-a737-b8e7de63f99c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.265866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48995-3756-412c-a737-b8e7de63f99c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.267117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 128/279] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:55.267808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b48995-3756-412c-a737-b8e7de63f99c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.350706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 152/280] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:15:55 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:15:55.353262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.353736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.354394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.370290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b48995-3756-412c-a737-b8e7de63f99c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.371208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:55.372462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:55.411402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.412742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.412742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.412742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.413621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, user.id=ba5aa7a738634dbea51bfd4e95d4b75d, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:55.413920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.415802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f29ce2-935f-4ffb-8b31-20acac1dd766 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.432536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 129/281] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/role_assignments?user.id=ba5aa7a738634dbea51bfd4e95d4b75d&scope.system=all&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:55.432536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.432536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.432536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.447713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:55.449202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:55.463402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.473458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.475849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 153/282] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:55.499869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.546683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 130/283] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:55.568593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.636843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407676b7-1ac2-4e4c-838e-d30aa514b6b5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.678485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.679331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.679614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.679930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.693206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:55.698029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeea9-996f-434e-be18-a218704fa12d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:55.703315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:55.704193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:55.705041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 154/284] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:55.709565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.745866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.746998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.746998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.747261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.762145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:55.771562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:55.772574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:55.773397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:55.775175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 131/285] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:55.780805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.796945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.800813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:55.844899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a085-34f8-45d8-8e9c-0becd3391d60 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.885899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.886903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.887255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.887531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.888277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:55.888704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.890100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.911727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 155/286] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:55.912021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dcf14-bfd2-4362-b4a6-95241fd3df9c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:55.916937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:55.957370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:55.958059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:55.958346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:55.958626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:55.960349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:55.960691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:55.962826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:55.973976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 132/287] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:55.979088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.074336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a0e9-e0f6-424a-9d4c-bd7066eff395 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.105655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:56.128898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:56.146928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.147836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.148122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.148398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] PATH_INFO: `/v3/users/afe8ed5fdef6421e8e7ba03012836d26` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.150966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] RBAC: Authorizing `identity:get_user(user_id=afe8ed5fdef6421e8e7ba03012836d26)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.152932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.155808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 156/288] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/users/afe8ed5fdef6421e8e7ba03012836d26 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:56.160542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.188886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcf61-3532-468e-8ee5-3d85020b3320 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.238562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.239531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.239814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.240084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] PATH_INFO: `/v3/users/34e6111da23043f88d54920adcec02fb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.241337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] RBAC: Authorizing `identity:get_user(user_id=34e6111da23043f88d54920adcec02fb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.243198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.245519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 133/289] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:55 2022] GET /identity/v3/users/34e6111da23043f88d54920adcec02fb => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:56.250891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.275896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f61f5-e005-43d4-9003-a5ab0df0a340 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.309799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.310462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.310745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.311027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.368562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:56.381001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.382474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.479616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6425e-a9a6-4723-9f9c-dc2898612902 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.484713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 157/290] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:15:56.490215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.534168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.535040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.535318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.535586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.541276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.542908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.545062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 134/291] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:56 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:56.550340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.569153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:56.578932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:56.591249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab907e8-6eab-48d3-ba94-d8b94bd11a1d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.625495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.626296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.626581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.626853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.628108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.629621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.631323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 158/292] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:15:56 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:56.637859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:56.679974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863123b-be7b-44a0-9143-d5191f1482ba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.732126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.733044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.733318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.733587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/users/34e6111da23043f88d54920adcec02fb/roles/a81f50697b1f42eeb332b2a684e18008` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.741951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, user_id=34e6111da23043f88d54920adcec02fb, role_id=a81f50697b1f42eeb332b2a684e18008)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.743962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93e4e-9c2f-42b9-ae1a-1870e227bae0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.750483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690a5c-8925-4b69-957d-3d0b78482bb3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:56.788764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:56.790170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:56.790454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:56.790767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:56.791761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=afe8ed5fdef6421e8e7ba03012836d26) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:56.792075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:56.793694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aad6d-f56f-4164-b39a-f449a7f2ca98 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:56.800966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 159/293] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:15:56 2022] GET /identity/v3/role_assignments?user.id=afe8ed5fdef6421e8e7ba03012836d26&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:56.830990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 135/294] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:15:56 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/users/34e6111da23043f88d54920adcec02fb/roles/a81f50697b1f42eeb332b2a684e18008 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:15:57.872413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9521c7-4bc3-4cc2-a833-376c99f66072 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:57.872970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9521c7-4bc3-4cc2-a833-376c99f66072 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:57.872970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9521c7-4bc3-4cc2-a833-376c99f66072 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:57.874627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 160/295] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:57.880521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:57.881029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:57.881104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:57.905124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:57.906591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:57.951495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca197-35cf-441a-9407-f9289e6c4c83 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:57.951803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca197-35cf-441a-9407-f9289e6c4c83 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:57.952054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca197-35cf-441a-9407-f9289e6c4c83 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:57.953595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 161/296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:15:57.958463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:57.958755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:57.959298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:57.975758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:57.977547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:57.980313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 136/297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:57.997985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.003216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.019848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.068117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 162/298] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:15:58.092529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.123396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5028-1e28-4cce-a223-00a833d83fad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.164741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51048cef-b543-4797-97f2-802a197758ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.165890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51048cef-b543-4797-97f2-802a197758ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.166487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51048cef-b543-4797-97f2-802a197758ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.167027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51048cef-b543-4797-97f2-802a197758ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.178750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51048cef-b543-4797-97f2-802a197758ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-51048cef-b543-4797-97f2-802a197758ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:58.190201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:58.191175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:15:58.191955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:58.200353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 137/299] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:58.201803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51048cef-b543-4797-97f2-802a197758ca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.231691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f36ec9-da63-4286-aa97-e77413255f5c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.274007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.275082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.275369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.275632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.279929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.286654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e47a1c83-cfb2-44c5-bf6b-1d8c75d1f590 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:58.295371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:58.296253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:58.297066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:15:58.301497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 163/300] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:15:58.302575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609b398-62ad-4467-ba2b-4a63692b2d8b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.303035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609b398-62ad-4467-ba2b-4a63692b2d8b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.303137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609b398-62ad-4467-ba2b-4a63692b2d8b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.308568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 164/301] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:58.308568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609b398-62ad-4467-ba2b-4a63692b2d8b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.321160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.325651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51048cef-b543-4797-97f2-802a197758ca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.361404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.362080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.362385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.362638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.363392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:58.363699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.365189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11081-a3a4-41b7-adeb-d92271e6afe1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.374531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 138/302] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:58.375570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.375862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.376140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.393502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:58.394695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:58.420250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609b398-62ad-4467-ba2b-4a63692b2d8b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.455682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.456354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.456679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.457149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.457697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:58.458011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.459464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.477007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 139/303] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:58.477007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.477334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 165/304] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:58.482925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.536418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.555576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.583018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a05f-c4d5-4936-88dc-48b29b1ac05d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.584743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49d557-e21f-44fc-a8e5-53ce25e35573 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.619679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.620037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.620575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.620862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.620979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.621131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] PATH_INFO: `/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.621221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.621465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] PATH_INFO: `/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.622520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] RBAC: Authorizing `identity:get_user(user_id=ba5aa7a738634dbea51bfd4e95d4b75d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.623985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.630509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 140/305] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:58.630509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.638746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] RBAC: Authorizing `identity:get_user(user_id=aa60a2d95ed54d60baf594ddd8b0aa49)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.640634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.642954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 166/306] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:15:58.643877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.740805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce8c6-3368-410b-8258-b16bd627848c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.747671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2ede-4ddb-4195-b63c-a79daef1be39 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.765033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.776920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.780349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.780349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.780349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.780592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:58.780666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.781008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.782632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 141/307] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:58.787230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.789266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.790283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.790570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.790851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] PATH_INFO: `/v3/system/users/ba5aa7a738634dbea51bfd4e95d4b75d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.792441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba5aa7a738634dbea51bfd4e95d4b75d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.793861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b25147-badf-48eb-94ce-d5ff1d171698 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.891720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79590-35b7-4131-acf5-efbc2501399c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:58.925952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:58.926613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:58.926898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:58.927177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:58.928017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, user.id=aa60a2d95ed54d60baf594ddd8b0aa49, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:58.928379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:58.930353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:58.935395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 142/308] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 08:15:58 2022] GET /identity/v3/role_assignments?user.id=aa60a2d95ed54d60baf594ddd8b0aa49&scope.system=all&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:58.936155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:58.939968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 167/309] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 17 08:15:58 2022] PUT /identity/v3/system/users/ba5aa7a738634dbea51bfd4e95d4b75d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:15:59.012237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:59.064897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208931-a99f-44b3-8566-643fdd51d95b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:59.106298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:59.106999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.107283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.107563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.108303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:59.109890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:59.194975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79415-6f96-4675-ba79-704b951099c9 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.195271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79415-6f96-4675-ba79-704b951099c9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.195530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79415-6f96-4675-ba79-704b951099c9 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.197293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 168/310] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:15:59.199478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 143/311] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 17 08:15:58 2022] POST /identity/v3/groups => generated 229 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:15:59.202654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.208742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.208742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.222209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:15:59.223412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:15:59.302278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 169/312] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:15:59.327431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:59.438953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e1b61-1527-48c0-b211-9674b8ad65b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:59.453198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:59.472992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:59.473814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.474094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.474374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.489500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:15:59.498447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:15:59.499981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:15:59.500767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 144/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:15:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:15:59.508006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:59.610647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c45d4-190b-446c-a5bb-88eb7b8f204d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:59.635698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:15:59.646742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:59.647424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.649501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.649501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.649501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:15:59.649501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:59.650509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:59.659376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 170/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:15:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:59.665765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:59.770079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78c70-2580-45ca-b8c2-3258697a5aca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:59.806233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:59.807499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.807993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.808454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] PATH_INFO: `/v3/users/34e6111da23043f88d54920adcec02fb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:15:59.809898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] RBAC: Authorizing `identity:get_user(user_id=34e6111da23043f88d54920adcec02fb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:15:59.811540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:15:59.813774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 145/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:15:59 2022] GET /identity/v3/users/34e6111da23043f88d54920adcec02fb => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:15:59.819421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:15:59.928601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f037-1b79-4c60-9993-f249bbca779b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:15:59.962851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:15:59.963502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:15:59.963770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:15:59.964043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:00.019653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:00.038151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:00.038151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:00.145748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 171/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:00.152319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:00.198020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:00.272779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3314b3-993a-4684-80aa-04f8df531686 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:00.307891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:00.308702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:00.308985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:00.309261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:00.310456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:00.311901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbd864-311c-45d5-b79e-ec637bf9e310 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:00.313943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 146/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:00 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:00.319583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:00.407458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:00.422902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aef626-763d-4cbc-a976-eaedf7f41d03 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:00.458260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:00.458920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:00.459201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:00.459481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:00.460355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, scope.project.id=00775c4f7bce4723b436241315ccdaed, user.id=34e6111da23043f88d54920adcec02fb) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:00.460770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:00.462594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df914e-0e06-4f77-95ce-e380dae95267 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:00.468792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 172/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:00 2022] GET /identity/v3/role_assignments?user.id=34e6111da23043f88d54920adcec02fb&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:01.192310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f90c6-75ab-4f00-8a98-9cd556e4ef06 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.192835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f90c6-75ab-4f00-8a98-9cd556e4ef06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.192835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f90c6-75ab-4f00-8a98-9cd556e4ef06 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.194419 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 147/319] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:01.200389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.200916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.200989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.217835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:01.219026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:01.234144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2176-56fe-491d-afd1-f256d067ce1e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.234434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2176-56fe-491d-afd1-f256d067ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.234714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2176-56fe-491d-afd1-f256d067ce1e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.236077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 148/320] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:16:01.240960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.241250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.241521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.260299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:01.261435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:01.296886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 173/321] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:01.319922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.332532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 149/322] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:01.354456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.399985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.408310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.427271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a29c2a-0a87-45b5-9918-c053ceb48292 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.458387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac0aa2-c8f1-4f50-a0ce-25249ca12def None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.461435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.462249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.462533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.462812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.473062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:01.481536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:01.493792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 174/323] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:01.494579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.500882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.501705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.501981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.502249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.514960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:01.523077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:01.524602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:01.525550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 150/324] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:01.530452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.599313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084cd1-804e-4785-9447-860f1959cd18 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.625352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.628382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e980-be76-4a1a-907d-b919dfd14805 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.632704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.633401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.633682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.633956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.634709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:01.635014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:01.636661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc60d1-da22-4899-92ee-c20b479c1b25 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:01.644624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 175/325] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:01.645846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d22-b319-436a-8a35-d93ed1cd523b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.647495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d22-b319-436a-8a35-d93ed1cd523b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.647495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d22-b319-436a-8a35-d93ed1cd523b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.647641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 176/326] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:01.649950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073d22-b319-436a-8a35-d93ed1cd523b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.652655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.666374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.667051 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.667335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.667614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.668365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:01.668709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:01.670151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793777b-4fe9-43b5-9263-9c9860b153d9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:01.678609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 151/327] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:01.680655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.680947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.681225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.697835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:01.699029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:01.754925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073d22-b319-436a-8a35-d93ed1cd523b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.764873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 152/328] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:01.765545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.795499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.796638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.796923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.797198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] PATH_INFO: `/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.798407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] RBAC: Authorizing `identity:get_user(user_id=ba5aa7a738634dbea51bfd4e95d4b75d)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:01.799842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:01.801505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 177/329] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/users/ba5aa7a738634dbea51bfd4e95d4b75d => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:01.802327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.859559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.868726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c614a8-dd99-4c1d-abac-26be719ac593 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.877795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:01.904372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954def30-bd33-4a52-97ed-8a946f32b21c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:01.904564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.905320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.905622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.906069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] PATH_INFO: `/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.907666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=aa60a2d95ed54d60baf594ddd8b0aa49)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:01.909533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:01.911169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 153/330] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:01.911922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:01.937885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:01.938684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:01.938963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:01.939237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:01.940406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:01.941880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:01.943483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 178/331] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:01.944205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:02.009234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd68a-53de-49aa-bb7c-dd8ea614e7d3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:02.042992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:02.043164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493318a4-ddb8-42e5-9147-8d8d4f0a7289 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:02.043646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:02.043929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:02.044206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:02.045072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] RBAC: Adding query filter params (role.id=1fcd0eca8a9c45a9959c033d5164bf85, user.id=ba5aa7a738634dbea51bfd4e95d4b75d, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:02.045388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:02.046824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:02.058892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 154/332] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 08:16:01 2022] GET /identity/v3/role_assignments?user.id=ba5aa7a738634dbea51bfd4e95d4b75d&scope.system=all&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 510 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:02.059893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:02.078443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:02.079354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:02.079635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:02.079912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] PATH_INFO: `/v3/system/users/aa60a2d95ed54d60baf594ddd8b0aa49/roles/a81f50697b1f42eeb332b2a684e18008` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:02.081580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa60a2d95ed54d60baf594ddd8b0aa49, role_id=a81f50697b1f42eeb332b2a684e18008)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:02.083003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c17b0a-d06a-4991-aa4f-d737298a0421 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:02.091972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:02.162900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 179/333] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 17 08:16:01 2022] PUT /identity/v3/system/users/aa60a2d95ed54d60baf594ddd8b0aa49/roles/a81f50697b1f42eeb332b2a684e18008 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:02.244760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529d60b-5c7f-4590-92d7-825ede84e3cd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:02.284471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:02.285097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:02.285375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:02.285658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:02.286356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:02.287820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76e606-d678-4338-b246-68dd12ae9d83 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:02.380459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 155/334] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 17 08:16:02 2022] POST /identity/v3/groups => generated 226 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:04.642011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1ee6-fece-46ad-84cb-e4df2e02a45b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:04.643010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1ee6-fece-46ad-84cb-e4df2e02a45b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:04.643520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1ee6-fece-46ad-84cb-e4df2e02a45b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:04.645404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 180/335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:04.650741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:04.651578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:04.652052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:04.674334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:04.675868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:04.754504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 156/336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:04.789697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b1ee6-fece-46ad-84cb-e4df2e02a45b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:04.793021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:04.913666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b1ee6-fece-46ad-84cb-e4df2e02a45b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:04.958506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:04.959345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:04.959629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:04.959904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:04.974356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e70ff481-636e-4fa8-9d93-726e29318f69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:04.982698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:04.983632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:04.984401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 181/337] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:04.989757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.003507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:05.050755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2474-faea-4569-b19b-35347bff9da8 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.051106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2474-faea-4569-b19b-35347bff9da8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.051315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2474-faea-4569-b19b-35347bff9da8 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.052840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 182/338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:05.074285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9167-12fd-4057-9088-aff977ca7f1c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.074832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9167-12fd-4057-9088-aff977ca7f1c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.075258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9167-12fd-4057-9088-aff977ca7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.122261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b75d9167-12fd-4057-9088-aff977ca7f1c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:05.125024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b75d9167-12fd-4057-9088-aff977ca7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:05.147800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6785-b42b-47de-b00c-cfbd9e295362 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.237317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.238356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.238834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.239302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.240251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:05.240795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:05.243307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e28a-26ad-4e53-bc88-891e3edd63d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:05.260434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 157/339] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:05.263041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fd8-7390-4a16-85dd-767849682802 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.263546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fd8-7390-4a16-85dd-767849682802 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.264040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fd8-7390-4a16-85dd-767849682802 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.265784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 158/340] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:05.270911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4193fd8-7390-4a16-85dd-767849682802 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.272850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:05.303142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 183/341] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:05.305309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.308893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.309343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.334969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:05.336606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:05.393256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:05.461613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4193fd8-7390-4a16-85dd-767849682802 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.474919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 184/342] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:05.475838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.537954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.538895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.539384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.539732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] PATH_INFO: `/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.541742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] RBAC: Authorizing `identity:get_user(user_id=aa60a2d95ed54d60baf594ddd8b0aa49)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:05.543173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:05.548852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 159/343] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/users/aa60a2d95ed54d60baf594ddd8b0aa49 => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:05.549636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.639125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe9e37-a5b4-4f41-b8d3-84fc0e2fe5cd None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.668554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:05.682712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb7f6-d085-4a59-9fe2-c47d3154b410 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.686745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.687580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.687863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.688134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.702252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-1ff78fd6-d3e7-4933-ac2a-0f6fa08a01ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:05.711666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:05.712837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:05.713766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:05.716758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 185/344] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:05.718502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96aa41-9984-4f5e-9ff6-1bf6db01c8c8 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.718983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96aa41-9984-4f5e-9ff6-1bf6db01c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.719452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96aa41-9984-4f5e-9ff6-1bf6db01c8c8 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.724701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 186/345] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:05.725558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96aa41-9984-4f5e-9ff6-1bf6db01c8c8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.727395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.728296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.728601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.728874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.737605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:05.741217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:05.749797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:05.752885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:05.753790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 160/346] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:05.754838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.870169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96aa41-9984-4f5e-9ff6-1bf6db01c8c8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.878206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1910d3-6d34-4367-b759-04280b9ce8dc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:05.911191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.911191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.911191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.911191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.912095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] RBAC: Adding query filter params (role.id=a81f50697b1f42eeb332b2a684e18008, user.id=aa60a2d95ed54d60baf594ddd8b0aa49, scope.system=all) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:05.912308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:05.915517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334148-207b-48a3-9336-1953acc0dfdc None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:05.928027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:05.929061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 187/347] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/role_assignments?user.id=aa60a2d95ed54d60baf594ddd8b0aa49&scope.system=all&role.id=a81f50697b1f42eeb332b2a684e18008 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:05.929440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.929803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.930198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.931028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:05.931433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:05.931546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:05.932017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:05.932555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:05.933121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:05.943639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 161/348] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:05.944653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:05.959272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:05.961527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:06.001928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.010552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.041332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 188/349] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:06.042615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.054949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a60c-9b56-42fd-b522-73f88676ac88 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.093860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.094549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.095452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.095738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.096843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:06.097156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:06.099406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:06.111264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 162/350] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:06.111468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.183854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120cc00-8b12-4d71-9d37-4d956f5764b9 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.227039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.227767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.228050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.228330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.259309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd0b1-84ac-4a0c-8648-2789d9562561 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.299399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.300875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.323211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.324943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.325741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.326239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.326409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:06.327844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:06.340795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:06.351751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:06.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:06.354383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:06.354988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 163/351] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:06.355796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.452926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 189/352] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:06.454160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.483887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8567-b403-40da-98c7-d9f7d13b7de1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.529983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4365285-b233-400c-b567-06c24be82660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.531372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365285-b233-400c-b567-06c24be82660 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.531959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365285-b233-400c-b567-06c24be82660 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.532578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365285-b233-400c-b567-06c24be82660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.544850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.595827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67231ab2-56cd-442e-84a6-7078aa778037 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.612996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.638167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4365285-b233-400c-b567-06c24be82660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:06.640665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4365285-b233-400c-b567-06c24be82660 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:06.646386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.647159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.647523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.647930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.648884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:06.649258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:06.650722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:06.664639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 190/353] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:06.666178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.770726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 164/354] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:06.772023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437cdf7-6eb7-4d10-83fa-1aacb153f7cf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.772314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437cdf7-6eb7-4d10-83fa-1aacb153f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.772614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437cdf7-6eb7-4d10-83fa-1aacb153f7cf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.774134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 165/355] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:06.774848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437cdf7-6eb7-4d10-83fa-1aacb153f7cf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:06.798921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1c33-aa6a-487f-bdbb-087d94425cc7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.841109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.849466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.850649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.851469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.851835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.854885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:06.854885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1688b-81e1-4f1b-af32-56f9657fca75 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:06.857815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 191/356] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:06.858237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.861996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.861996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.879645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:06.880883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:06.897949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:06.927610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437cdf7-6eb7-4d10-83fa-1aacb153f7cf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:06.973322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:06.974267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:06.974554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:06.974831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:06.978243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 192/357] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:06.979181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.059160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.060572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.110987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fff74-2d64-4da5-bdd0-f064ffb53900 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.163421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.169946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.170825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.171103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.171221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.171419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.172742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.174196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.175925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 193/358] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.181392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.193869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 166/359] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:07.195341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.301238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02a88-d3ec-4a9d-8487-32c723334359 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.317576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485da0-69f5-4892-8d7d-42ae016f7c4e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.342752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.343628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.343911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.344187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.350384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.352529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1af736-e54e-4dea-9d37-3976f6071cb6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.354143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 194/360] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.355352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634ce7-867a-4507-bd98-c73e8128433e None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.355463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634ce7-867a-4507-bd98-c73e8128433e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.355765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634ce7-867a-4507-bd98-c73e8128433e None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.357198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 195/361] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:07.357712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634ce7-867a-4507-bd98-c73e8128433e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.361755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.362596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.362884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.363162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.375571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:07.384654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:07.385542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 167/362] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:07.386996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.434190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.444406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.485128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634ce7-867a-4507-bd98-c73e8128433e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.513117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f05fe-5a41-43ab-9812-b698c66a77de None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.526462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.527336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.527618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.527891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.529139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.530588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.532596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 196/363] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.533549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.565484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.567312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.567312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.567312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.569390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.571029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad789ec-4b9d-4a94-ad0f-a4e8363dd57c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.572944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 168/364] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.577923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.578212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.578496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.596174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:07.597385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:07.662472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a418-7155-4838-90f7-c82c3688c278 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.682734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 169/365] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:07.683722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.698800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.705441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.706337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.706781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.713833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.713833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=6dd8667bcb0145f5a24c5dded225829f) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:07.713833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.713833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.716689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 197/366] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=b5c3b136cc84423fb874b4d72253033e => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.718168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.739703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:07.810138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a39593-58dc-4c0d-b0ab-660a5793afc1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.862363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.862972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.864473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.864473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.864473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:07.864722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.865975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.878967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 170/367] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.880142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:07.885511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfd00b-e7cc-4f00-a604-6fa50ce01bdd None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:07.927616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:07.928730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:07.930149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:07.931031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:07.931897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=00775c4f7bce4723b436241315ccdaed) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:07.932209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:07.934589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:07.940520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 198/368] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:07.941219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.017436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.021078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c3825-f1f3-40a1-aa2e-8efde37834c4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.023568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.068114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65ed1-c0e9-4d91-a556-75798824fa15 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.068340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.069246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.069527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.070410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.071934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.073609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.080652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 171/369] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:08.081228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.132219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09032752-10cb-4251-9caa-963bd25320de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.133523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032752-10cb-4251-9caa-963bd25320de None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.133806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032752-10cb-4251-9caa-963bd25320de None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.134142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032752-10cb-4251-9caa-963bd25320de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.149869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09032752-10cb-4251-9caa-963bd25320de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-09032752-10cb-4251-9caa-963bd25320de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:08.157781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:08.158674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:08.159439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:08.164388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 199/370] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:08.165304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09032752-10cb-4251-9caa-963bd25320de None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.214939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e90262-168b-4f59-91f2-35280da776bc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.258431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.259452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.259903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.260321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.280574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09032752-10cb-4251-9caa-963bd25320de None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.311704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.313516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.334373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.336140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.336599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.337024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.338180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=6dd8667bcb0145f5a24c5dded225829f) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:08.338995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.341071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.349328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 200/371] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:08.350639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.356516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.356516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.494722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec561-0fed-49b3-9e68-479362da5c1f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.536614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.538158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.538741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.539440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.540409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:08.540886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.542453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.552788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 201/372] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:08.561778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.622336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.648153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 172/373] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:08.649790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.691678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685f27-ec00-44e3-91b1-fb01c3c4d17a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.733052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.733867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.734246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.734619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.739062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.785425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff546d-4754-42aa-9405-fdfee83ed7e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:08.822013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.823486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.858710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:08.859586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:08.859867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:08.860138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:08.861931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:08.863381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:08.866830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 173/374] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:08.871939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:08.896452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:08.998662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9d6c-ce44-4c25-b7e2-829a8688d901 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:09.005399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 202/375] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:09.013836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:09.045125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:09.046007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:09.046288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:09.046563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:09.047743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:09.051651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:09.058515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 174/376] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:08 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:09.059708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:09.076851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:09.167670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21fdc-6f6a-46a8-b34f-9ca3be144db5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:09.203945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:09.204723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:09.205096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:09.205437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:09.206280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=00775c4f7bce4723b436241315ccdaed) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:09.206600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:09.208106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:09.216591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 175/377] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:09 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=b5c3b136cc84423fb874b4d72253033e => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:09.281036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48278d-d40c-40b6-982e-e5f99c118208 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:09.344042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:09.344966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:09.345244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:09.345528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] PATH_INFO: `/v3/projects/82d4449a875a4811837ecf2ea9ba71ec` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:09.347186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] RBAC: Authorizing `identity:get_project(project_id=82d4449a875a4811837ecf2ea9ba71ec)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:09.348680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:09.350441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 203/378] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:09 2022] GET /identity/v3/projects/82d4449a875a4811837ecf2ea9ba71ec => generated 344 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:09.357145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:09.470136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:09.511736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebc2d-327a-4a58-8526-e25a6cbd13ac None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:09.547968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:09.548853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:09.549200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:09.549476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] PATH_INFO: `/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:09.556141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] RBAC: Authorizing `identity:get_group(group_id=4a43c3b3de634ad4a3f915c673ad5bca)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:09.557644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8744-9740-4ed8-be7d-4fb76c080801 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:09.559563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 176/379] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:09 2022] GET /identity/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:09.569697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:09.587161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:09.698392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6278ce-66ea-49c8-8c31-0beee53a38f7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:09.745218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:09.745885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:09.746170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:09.746450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:09.747283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] RBAC: Adding query filter params (group.id=4a43c3b3de634ad4a3f915c673ad5bca, role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=82d4449a875a4811837ecf2ea9ba71ec) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:09.747598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:09.749068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c84e6-91a2-45aa-af4e-2de58f49d5e0 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:09.761404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 204/380] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:09 2022] GET /identity/v3/role_assignments?group.id=4a43c3b3de634ad4a3f915c673ad5bca&scope.project.id=82d4449a875a4811837ecf2ea9ba71ec&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:10.543731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387708-9e81-4a22-9b54-9b645eb08707 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:10.544240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387708-9e81-4a22-9b54-9b645eb08707 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:10.544314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387708-9e81-4a22-9b54-9b645eb08707 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:10.545945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 177/381] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:10.551552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858470-df39-4940-95dc-81bf78ff45c7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:10.552420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858470-df39-4940-95dc-81bf78ff45c7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:10.552919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858470-df39-4940-95dc-81bf78ff45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:10.571070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ab858470-df39-4940-95dc-81bf78ff45c7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:10.572562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ab858470-df39-4940-95dc-81bf78ff45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:10.664122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 205/382] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:10.687888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8387708-9e81-4a22-9b54-9b645eb08707 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:10.701051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa5a2-2663-4a19-a65b-b260267c42c1 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:10.701664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa5a2-2663-4a19-a65b-b260267c42c1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:10.703785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa5a2-2663-4a19-a65b-b260267c42c1 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:10.706967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 206/383] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:10.711887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:10.712391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:10.712885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:10.730133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:10.740200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:10.741977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:10.822346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 207/384] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:10.861732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:10.887069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8387708-9e81-4a22-9b54-9b645eb08707 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:10.949760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:10.952262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:10.952706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:10.954058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:10.959014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:10.978111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:10.999673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:11.000760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:11.001736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:11.003720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 178/385] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:11.009684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.053281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63274f63-2dc8-44ee-928f-5411cb29722b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.091971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.093123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.093544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.093976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.098048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.112859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:11.127761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:11.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:11.129774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:11.144529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 208/386] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:11.149491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.175122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324d329-c24e-47d1-8cb6-2d78d4f70bf7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.243463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.244387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.244899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.245279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.246235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:11.246656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.248237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8398a87-1d55-4000-872c-c1f153c35f09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.262559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 179/387] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:11.264225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a74784-51f0-4897-9891-5dd8c08f80cd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.264658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a74784-51f0-4897-9891-5dd8c08f80cd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.265040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a74784-51f0-4897-9891-5dd8c08f80cd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.266478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 180/388] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:11.267353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a74784-51f0-4897-9891-5dd8c08f80cd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.302561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf74a-2780-4095-adca-41d87bf2bdb9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.338639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.339488 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.339773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.340375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.341453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:11.341762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.343847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38753e2f-53cd-4a77-98d1-9634e47d73a3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.355177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 209/389] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.356464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.356775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.357049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.360675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.374973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:11.376564 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:11.396613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a74784-51f0-4897-9891-5dd8c08f80cd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.435803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.436883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.437272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.437653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.439076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.440901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.442811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 181/390] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.443514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.445061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.463541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 210/391] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:11.465209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.565093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5d394-d8f1-4f91-bd00-18c11cec0e39 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.590550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.607646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.607646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.607646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.607646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.608376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053921-8a56-4c6d-8e3d-177ffac2a40f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.608918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.608918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.609339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 182/392] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.610541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.652379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.653315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.653599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.653878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.655526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.657397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.660097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 211/393] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.661096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.723423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052271-1a04-4790-bd5c-d596eb582ebc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.733394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.777211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.779084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.779894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.780327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.785063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe780-1e2d-4624-8edc-30079421d123 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.797148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:11.808896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:11.810034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:11.810972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:11.814233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 183/394] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:11.815832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.826061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.827119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.827496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.827871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.829334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.831255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.833286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 212/395] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.834138 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:11.880173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.936519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3d68-a9db-4780-80c7-c1f39a3e872f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.947183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f095ab5-3dd3-4885-8b16-6fc976e03aae None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:11.972344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.972565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:11.973276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.973562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.973839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/groups/575de527ad174b03a3d3244fd0e8bab7/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.975904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, group_id=575de527ad174b03a3d3244fd0e8bab7, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.977503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9958a1-30c2-40c3-91e1-2e11ae58fbdd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.983614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:11.984300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:11.984591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:11.984864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:11.985605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:11.985932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:11.990844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:11.996038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 213/396] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:11.996874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.072776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 184/397] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 08:16:11 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/groups/575de527ad174b03a3d3244fd0e8bab7/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:12.074363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9e90-72c5-4920-8835-6b2b29b966be None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.074649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9e90-72c5-4920-8835-6b2b29b966be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.074920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9e90-72c5-4920-8835-6b2b29b966be None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.084073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 185/398] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:12.084073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9e90-72c5-4920-8835-6b2b29b966be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.115964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b37f-9b36-4b02-9759-1a0b71ec115f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.164694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.166306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.166667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.167031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/groups/575de527ad174b03a3d3244fd0e8bab7/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.170523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, group_id=575de527ad174b03a3d3244fd0e8bab7, role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:12.172652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7261f-8dd5-4ab0-bbb4-4631acc06f28 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:12.221594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9e90-72c5-4920-8835-6b2b29b966be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.238623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:12.260659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.261774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.262053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.262338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.263091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 214/399] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 08:16:11 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/groups/575de527ad174b03a3d3244fd0e8bab7/roles/b5c3b136cc84423fb874b4d72253033e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:12.264735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.268289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.268392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:12.268469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.268588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:12.273290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 186/400] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:12.274947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.285975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:12.287769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:12.340316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:12.380732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 215/401] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:12.402747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.461530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4ee-351f-4b95-9149-4c93b95b4c01 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.515176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.516722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.517673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.518308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.520186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:12.522499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:12.523763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89798a31-7ff0-4b6f-8cb9-7597c22e1db2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.528846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 187/402] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:12.534507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.582717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.583857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.584150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.584430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.600330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:12.605353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-76465fc3-c6a1-4900-a17b-2a33cc4ecb14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:12.612235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:12.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 216/403] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:12.623202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded7c8-ef94-40e7-a619-c641814a82a6 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.624176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded7c8-ef94-40e7-a619-c641814a82a6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.624176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded7c8-ef94-40e7-a619-c641814a82a6 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.624176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 217/404] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:12.624176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ded7c8-ef94-40e7-a619-c641814a82a6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.669779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:12.675205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cead67f-99c8-4e66-bed6-87585a98ca30 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.711808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.712642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.712925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.713254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f/groups/575de527ad174b03a3d3244fd0e8bab7/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.715415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8667bcb0145f5a24c5dded225829f, group_id=575de527ad174b03a3d3244fd0e8bab7, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:12.717028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:12.742425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ded7c8-ef94-40e7-a619-c641814a82a6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:12.777048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:12.777727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.778014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.778294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.779153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:12.779464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:12.780860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241df44-5f47-4985-ac5a-1858741b8d54 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:12.794445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 218/405] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:12.794445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:12.794445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:12.794445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:12.809925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:12.811186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:12.831823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 188/406] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 08:16:12 2022] PUT /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f/groups/575de527ad174b03a3d3244fd0e8bab7/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:12.837163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:12.930259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 219/407] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:12.970646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.018257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:13.056547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186638-e8be-46ae-88ec-c07acd54eb23 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.070769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:13.100412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60d84-e6fb-4759-80be-31a1a4940d21 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.105914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.107344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.107478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.107661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.108942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.110420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.112843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 189/408] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:13.119599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.148015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.149461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.149832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.150176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.176580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:13.190999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:13.191916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:13.192776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:13.196249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 220/409] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:13.203105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.300977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c4c4-ea78-4d62-93e5-42f915f058ce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.351402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:13.364331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea0cb-046a-46ac-a0a6-b9a4bdb25950 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.380114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.380816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.381093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.381385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.383472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.384955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.387262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 190/410] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:13 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:13.394201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.416334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.417262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.417940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.419063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.421458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:13.421914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.423620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.442200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 221/411] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:13.449627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.490152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:13.585893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98002-dbc8-445c-84b7-a5e62e77061c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.586712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767b5e-9d41-4cf6-815e-0b2b9f196a6d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.623169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.624052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.624336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.624610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.624993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed/groups/575de527ad174b03a3d3244fd0e8bab7/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.625969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.626391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.626817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] PATH_INFO: `/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.626923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] RBAC: Authorizing `identity:create_grant(project_id=00775c4f7bce4723b436241315ccdaed, group_id=575de527ad174b03a3d3244fd0e8bab7, role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.628219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] RBAC: Authorizing `identity:get_group(group_id=4a43c3b3de634ad4a3f915c673ad5bca)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.628331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.629918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.632151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 222/412] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:13 2022] GET /identity/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:13.641466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.668962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:13.716391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 191/413] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 08:16:13 2022] PUT /identity/v3/projects/00775c4f7bce4723b436241315ccdaed/groups/575de527ad174b03a3d3244fd0e8bab7/roles/b5c3b136cc84423fb874b4d72253033e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:13.756634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc904-5d01-457f-b63e-8a3f7fa88695 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.806609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:13.807483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:13.807759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:13.808032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] PATH_INFO: `/v3/projects/82d4449a875a4811837ecf2ea9ba71ec` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:13.809297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] RBAC: Authorizing `identity:get_project(project_id=82d4449a875a4811837ecf2ea9ba71ec)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:13.810734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaa3aa-707b-4c9c-8afa-d3891a8fa9cb None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:13.812824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 223/414] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:13 2022] GET /identity/v3/projects/82d4449a875a4811837ecf2ea9ba71ec => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:13.818692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:13.972899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831d2d-b32a-4000-929e-39f5fab40843 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:13.977255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:14.020198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:14.021631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.021985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.022258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] PATH_INFO: `/v3/projects/82d4449a875a4811837ecf2ea9ba71ec/groups/4a43c3b3de634ad4a3f915c673ad5bca/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:14.024694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d4449a875a4811837ecf2ea9ba71ec, group_id=4a43c3b3de634ad4a3f915c673ad5bca, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:14.026127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d986-8d0b-477f-864b-f163cfe6c323 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:14.198535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 192/415] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 08:16:13 2022] PUT /identity/v3/projects/82d4449a875a4811837ecf2ea9ba71ec/groups/4a43c3b3de634ad4a3f915c673ad5bca/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:14.612809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffd9-1596-4270-8dd3-b096ac426c18 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.613153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffd9-1596-4270-8dd3-b096ac426c18 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.613364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555ffd9-1596-4270-8dd3-b096ac426c18 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:14.615293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 224/416] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:14.623280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d3bf-78e2-4865-976f-94d66330174d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.623781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d3bf-78e2-4865-976f-94d66330174d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.623983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d3bf-78e2-4865-976f-94d66330174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:14.654263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6ce6d3bf-78e2-4865-976f-94d66330174d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:14.655457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ce6d3bf-78e2-4865-976f-94d66330174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:14.754819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 193/417] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:14.765844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3fac-e8e7-461e-ba31-ce528f73b874 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.765844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3fac-e8e7-461e-ba31-ce528f73b874 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.765844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3fac-e8e7-461e-ba31-ce528f73b874 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:14.766927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 225/418] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:14.772219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.773056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.773338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:14.783775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be3fac-e8e7-461e-ba31-ce528f73b874 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:14.801619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:14.802724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:14.924865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:14.928048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 194/419] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:14.945772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be3fac-e8e7-461e-ba31-ce528f73b874 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:14.952519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:14.991795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:14.992808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:14.993090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:14.993358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.012281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.020125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:15.030529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:15.033645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:15.034415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 226/420] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:15.041448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.105507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf314d9-c5d8-4059-b939-06349c081718 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.147325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.148472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.148782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.149059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.171145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:15.192724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:15.193643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:15.194871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 195/421] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:15.199891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.215684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633f52-24d8-4db7-92ba-c9028fc738c6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.282525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.283210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.283495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.283768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.284545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:15.284916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:15.287406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:15.298336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 227/422] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:15.306303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.322321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.348384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.379573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a315-c91d-462f-8e09-60239813822d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.443495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e368-9a26-4172-b5fc-40ed65445ce1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.479075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.480085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.480546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.480968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.490504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.491290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.491670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.492068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.492931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:15.493240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:15.494629 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dca2d-377e-4d6a-bf2a-47b5731080a3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:15.508382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 196/423] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:15.509817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8820-99d3-4f0c-83bb-c5454f42aaad None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.510066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8820-99d3-4f0c-83bb-c5454f42aaad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.510347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8820-99d3-4f0c-83bb-c5454f42aaad None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.512144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 197/424] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:15.516917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8820-99d3-4f0c-83bb-c5454f42aaad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.553227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:15.555677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6ed5-d9d6-4c0f-8f69-019bc7aba460 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:15.594758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.620302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8820-99d3-4f0c-83bb-c5454f42aaad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.655413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.656208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.656464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.656912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.660052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 228/425] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:15.661698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.662228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.662707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.680263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.685102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:15.686536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:15.740449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:15.743083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:15.768732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 229/426] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:15.770340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.860004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 198/427] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:15.861384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.872874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.916974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24113f-bdf7-4370-8df3-844bfa22145c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:15.929375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:15.961284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:15.963465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:15.963849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:15.964226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:15.966257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:15.968084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:15.970148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 230/428] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:15.971861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:15.995345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45185a9-40bc-452c-804d-38c29c85cb59 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.033435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.034711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.039330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.039330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.047817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:16.056652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:16.057551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:16:16.058337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:16.061236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 199/429] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:16.062274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.095710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f741a6-6b5c-495b-84c1-07fd11a3f44d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.105519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.134537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.135750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.136506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.137168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.138596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.140516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.142619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 231/430] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:15 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.143961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.204315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded08c3-864e-432f-91c7-4f4b2721d2b1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.214804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.249982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.251180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.251477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.251763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.253312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.255408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.257937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd7be8-0ac6-4380-81af-fc39d72defb2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.260628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 200/431] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.261911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.300275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.301347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.301977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.302450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.304035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] RBAC: Adding query filter params (name=member) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:16.304587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.306445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.317132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 232/432] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.318409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.367578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.412149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf20d86-af52-40a6-81bd-bc3696872d07 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.446930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.447786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.448067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.448342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.449449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884087d-b3d2-466c-b965-13e5b101cabf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.449557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.450985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.456593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 201/433] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.456593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.491893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.492695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.492983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.493264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.494099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=00775c4f7bce4723b436241315ccdaed) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:16.494410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.495849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd93f3a-5832-4318-a5cb-c0a787f90bcf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.501072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 233/434] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4082d2-a7bb-4380-abdf-0cf274646df3 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4082d2-a7bb-4380-abdf-0cf274646df3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4082d2-a7bb-4380-abdf-0cf274646df3 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 234/435] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:16.509546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4082d2-a7bb-4380-abdf-0cf274646df3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.573307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b33e-d990-4e63-ae33-588853bcb855 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.618914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.619591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.619874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.620149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.631755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.636619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4082d2-a7bb-4380-abdf-0cf274646df3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.677090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:16.677992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.678306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.679311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.680346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=6dd8667bcb0145f5a24c5dded225829f) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:16.680807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.682413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae09b7-f05f-44f2-bc69-61b8e7bfd664 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.696397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 235/436] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=b5c3b136cc84423fb874b4d72253033e => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:16.698522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.698522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.698715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.700425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:16.701995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8f7c-cbe4-404e-b071-b3804c12526d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:16.724254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:16.726040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:16.785712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.820672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 236/437] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:16.847055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.871391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 202/438] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:16.872800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102298-0805-437c-85ce-f855316aab30 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:16.873086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102298-0805-437c-85ce-f855316aab30 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:16.873359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102298-0805-437c-85ce-f855316aab30 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:16.874934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 203/439] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:16.877326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b102298-0805-437c-85ce-f855316aab30 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:16.970372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:16.977729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342f82-bd88-4c15-bd07-3dc3aa948550 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:16.995188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b102298-0805-437c-85ce-f855316aab30 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.011113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.011923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.012208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.012501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.023043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:17.030175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.031027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0fcce9b3-9de6-4252-b42b-99ba8f3bb04a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:17.031152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:17.032029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:17.038930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:17.039598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.039598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] PATH_INFO: `/v3/projects/6dd8667bcb0145f5a24c5dded225829f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.039719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 237/440] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:17.039719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.039719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.039719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.039941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] RBAC: Authorizing `identity:get_project(project_id=6dd8667bcb0145f5a24c5dded225829f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.039941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.040945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 204/441] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:16 2022] GET /identity/v3/projects/6dd8667bcb0145f5a24c5dded225829f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:17.041706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.051081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:17.052261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:17.054376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.116940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 238/442] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:17.117777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.144355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772dc2-c50f-4784-94ae-94cdcb9c810e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.177694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.178413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.178727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.179003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.179751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:17.180057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.181450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.189263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 205/443] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:17.190039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.204468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.219717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662ea9-5e94-49ca-9a42-30f3288bfd73 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.252798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.253643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.253918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.254192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.255344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.257413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.258157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.259013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 239/444] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:17.259762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.287499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaca-ebb8-4afb-b7cc-c2e05ff5b336 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.321260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.321982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.322264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.322530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.332368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:17.340757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:17.341642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:17.342414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 206/445] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:17.343063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.359351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399bc6e-26af-427c-811f-bf89d455bdc5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.393099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.393749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.394034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.394312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.416045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.441495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2206b-bf59-4bb2-a390-56f044bdb6c3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.462078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.463552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.470029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.475443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.476090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.476368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.476671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.477495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=1fcd0eca8a9c45a9959c033d5164bf85, scope.project.id=6dd8667bcb0145f5a24c5dded225829f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:17.477799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.479298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.485324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 207/446] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=6dd8667bcb0145f5a24c5dded225829f&role.id=1fcd0eca8a9c45a9959c033d5164bf85 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:17.486178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.600229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 240/447] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:17.600439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd689e-144f-48da-9e49-3d22053a5d5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.602240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.637861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.638542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.638828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.639107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.639867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:17.640183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.641612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.651332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 208/448] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:17.656828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.670078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.727634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.732079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdaabe-eb1e-47cc-9e93-56e222416907 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.774506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.775374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.775656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.775934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] PATH_INFO: `/v3/projects/00775c4f7bce4723b436241315ccdaed` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.777729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] RBAC: Authorizing `identity:get_project(project_id=00775c4f7bce4723b436241315ccdaed)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.778109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b8d2-3b28-46ab-b0cf-28293aa476d5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.779173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.781297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 241/449] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/projects/00775c4f7bce4723b436241315ccdaed => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:17.786818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.822040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.822644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.822903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.823174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.907858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.909110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129adb-a7e2-4801-8116-f51f54bbad6c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:17.909540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.935423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:17.951077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:17.954183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:17.954183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:17.954183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] PATH_INFO: `/v3/groups/575de527ad174b03a3d3244fd0e8bab7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:17.954183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] RBAC: Authorizing `identity:get_group(group_id=575de527ad174b03a3d3244fd0e8bab7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:17.955314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:17.958542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 242/450] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/groups/575de527ad174b03a3d3244fd0e8bab7 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:17.963824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:17.979346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:18.029587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 209/451] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:18.035450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:18.081827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28637-0369-4e94-850b-0f2a6115511b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:18.121628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:18.122625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:18.123352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:18.123352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:18.124027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] RBAC: Adding query filter params (group.id=575de527ad174b03a3d3244fd0e8bab7, role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=00775c4f7bce4723b436241315ccdaed) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:18.124343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:18.125832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:18.134461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 243/452] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:17 2022] GET /identity/v3/role_assignments?group.id=575de527ad174b03a3d3244fd0e8bab7&scope.project.id=00775c4f7bce4723b436241315ccdaed&role.id=b5c3b136cc84423fb874b4d72253033e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:18.151942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264064-53ad-43fc-a247-78b10656d71c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:18.195758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:18.196724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:18.197006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:18.197274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] PATH_INFO: `/v3/projects/82d4449a875a4811837ecf2ea9ba71ec` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:18.198529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] RBAC: Authorizing `identity:get_project(project_id=82d4449a875a4811837ecf2ea9ba71ec)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:18.199980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:18.201827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 210/453] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:16:18 2022] GET /identity/v3/projects/82d4449a875a4811837ecf2ea9ba71ec => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:18.207622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:18.264143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:18.312453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8140f7-e279-4d97-878b-d4c8a5b977a4 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:18.346364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:18.347234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:18.347519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:18.347791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] PATH_INFO: `/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:18.349043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] RBAC: Authorizing `identity:get_group(group_id=4a43c3b3de634ad4a3f915c673ad5bca)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:18.350707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67443f3-1b84-48f0-b257-3fd65fa24443 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:18.352340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 244/454] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 08:16:18 2022] GET /identity/v3/groups/4a43c3b3de634ad4a3f915c673ad5bca => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:18.358318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:18.398230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:18.474617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a37-9160-4a0e-a5a2-d4a7d55f01fa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:18.510984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:18.511644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:18.511923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:18.512193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:18.513062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] RBAC: Adding query filter params (group.id=4a43c3b3de634ad4a3f915c673ad5bca, role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=82d4449a875a4811837ecf2ea9ba71ec) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:18.513371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:18.514802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1707a-ece9-466f-ae1b-a1d0c9c5ea80 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:18.520430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 211/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 08:16:18 2022] GET /identity/v3/role_assignments?group.id=4a43c3b3de634ad4a3f915c673ad5bca&scope.project.id=82d4449a875a4811837ecf2ea9ba71ec&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:21.094351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cdc4f-81be-4520-8cf5-0f4bd26b3aff None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.095355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cdc4f-81be-4520-8cf5-0f4bd26b3aff None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.095845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cdc4f-81be-4520-8cf5-0f4bd26b3aff None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.097730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 245/456] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:21.103359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.104222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.104736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.125526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:21.127079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:21.227485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 212/457] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:21.255883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7a55-a337-424e-894e-d08e18d6e522 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.256558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7a55-a337-424e-894e-d08e18d6e522 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.257126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7a55-a337-424e-894e-d08e18d6e522 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.258959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 246/458] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:21.260247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:21.263835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.264373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.264876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.294180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:21.296647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:21.311636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:21.449034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896810-43c5-4280-b389-6cc4a0eefaed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:21.453977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 247/459] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:21.492514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:21.503805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:21.504656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.504939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.505214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.526363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:21.528138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:21.560024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:21.560974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:21.561802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:21.561802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:21.561802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:21.561802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:21.574656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 213/460] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:21.575409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:21.581365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:21.641680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170ad74-3264-4368-bf50-1844ac5d1706 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:21.680411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:21.681587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.682033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.682452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.694401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:21.696280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:21.699980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-d55a370d-ba23-4c47-8ac0-12926c80eadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:21.714347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:21.716084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 248/461] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:21.717292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828bc7-b07b-48d4-81e8-5cb455609ac5 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.717610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828bc7-b07b-48d4-81e8-5cb455609ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828bc7-b07b-48d4-81e8-5cb455609ac5 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.719168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 249/462] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:21.720088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9e72-f112-4203-a880-7256fb466216 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.720373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9e72-f112-4203-a880-7256fb466216 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.720676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9e72-f112-4203-a880-7256fb466216 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.724718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 250/463] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:21.724718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9e72-f112-4203-a880-7256fb466216 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:21.737128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a85b0-3f75-402a-ad11-434729823388 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:21.773235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:21.773820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.774106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.774540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.775268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:21.775574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:21.776993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b382d-4f63-443f-8c8c-5b96ff681c61 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:21.789924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 214/464] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:21.791031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4b76-742c-44eb-a1c7-6b47b7da0c36 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.791322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4b76-742c-44eb-a1c7-6b47b7da0c36 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.791586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4b76-742c-44eb-a1c7-6b47b7da0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.811393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-382d4b76-742c-44eb-a1c7-6b47b7da0c36 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:21.813207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-382d4b76-742c-44eb-a1c7-6b47b7da0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:21.831969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9e72-f112-4203-a880-7256fb466216 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:21.833489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:21.867801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:21.868459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.868974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.869413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.870440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:21.870797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:21.872155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:21.891227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 215/465] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:21.891227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:21.891227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:21.891227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:21.900517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 251/466] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:21.901456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:21.917835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:21.919131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:21.979422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:21.989736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 216/467] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:21.991248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.019856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e656-c1f7-4618-af07-ae4e81cbe252 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.056784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.057376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.057749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.057990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.058624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.060142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.097908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725c93-e92f-4df9-a4ef-f3d9a7d502de None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.132192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.132942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.133224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.133497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.134191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.135913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.173973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 252/468] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:22.174806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.204778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:22.239536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 217/469] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:21 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:22.240630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.321261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:22.330117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7c1b1-e341-46db-b2ac-e0e16428e589 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.418846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.420389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.421153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.421907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.434014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccea245-3cc5-40e1-9cf4-8d5cf560db22 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.436068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.437898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:22.461557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:22.462430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:22.463285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:22.463285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:22.463285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:22.463285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:22.465732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 253/470] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:22.471573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.474043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.475816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.476298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.476627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.492591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.494386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:22.513232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:22.514161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:22.514987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:22.514987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:22.514987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:22.514987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:22.515951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 218/471] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:22.520667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.592873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:22.606184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf88bf-2093-4915-bbe5-f96cd1b349d9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.635561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:22.638901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa50-6b1d-4c31-a8bc-2db85d27c8ab None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.647158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.653164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.665850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 254/472] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:22.671409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.680196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.680922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.681212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.681492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.682242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:22.682554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.684417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.702844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 219/473] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:22.704073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:22.789237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57742b5b-3833-47f1-9056-96ba085ff3a0 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.824846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:22.829165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.829857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.830142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.830329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bf737-f88b-47fe-b212-fd20b9ea1cb2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:22.830427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.831121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.833850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbe230-24b0-4816-9971-5b06beead57d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.869213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:22.869885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.870181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.870456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.871163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:22.872763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:22.964203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 255/474] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:22 2022] POST /identity/v3/users => generated 249 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:22.966058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd73ce-4dc5-4dad-a15a-62436988567b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.966468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd73ce-4dc5-4dad-a15a-62436988567b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.966868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd73ce-4dc5-4dad-a15a-62436988567b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.968739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 256/475] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:22.974355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c598b-a538-4f10-a533-86528c524a1a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:22.975691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c598b-a538-4f10-a533-86528c524a1a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:22.976681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c598b-a538-4f10-a533-86528c524a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:22.986586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 220/476] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:22 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:16:23.004659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-600c598b-a538-4f10-a533-86528c524a1a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:23.006270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-600c598b-a538-4f10-a533-86528c524a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:23.094314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 257/477] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:23.130272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:23.160413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:23.279358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06293cc-2ab8-4d51-bac3-596734faa8df None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:23.316440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:23.317164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:23.317448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:23.317725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:23.319013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:23.320396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:23.384307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.sql.core [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:16:23.384307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 08:16:23.384307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [parameters: {'id': '0b031a1a7d4643ae81f255c3752ea08c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 08:16:23.384307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80264) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() Jun 17 08:16:23.401796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:16:23.402738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application yield resource Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise self.value Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application session.commit() Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:16:23.403715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:16:23.404614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:16:23.405530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:16:23.406377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [parameters: {'id': '0b031a1a7d4643ae81f255c3752ea08c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:23.407133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 08:16:23.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:23.409008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 221/478] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 08:16:23 2022] POST /identity/v3/roles => generated 144 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:23.409144 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c598b-a538-4f10-a533-86528c524a1a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:23.530061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c598b-a538-4f10-a533-86528c524a1a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:23.547579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:23.572570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:23.573393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:23.573680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:23.573951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:23.586046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8e0cd3f8-41a4-44fe-8394-cc85ba7b3732 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:23.594387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:23.596399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:23.598328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 258/479] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:16:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:23.601444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:23.704967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:23.729671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec40c-9967-4070-bcef-661af9d3b9cc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:23.768145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:23.768849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:23.769135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:23.769411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:23.770166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:23.770473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:23.771876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7532a-cef3-4d06-b4ee-0fa004c5b666 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:23.780957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 222/480] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:24.920675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6319b2-eded-436d-a88b-a9c3cd286601 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:24.921167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6319b2-eded-436d-a88b-a9c3cd286601 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:24.921273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6319b2-eded-436d-a88b-a9c3cd286601 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:24.922833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 259/481] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:24.929022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbcf5-42a1-41ba-b9c7-e688ccc8154c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:24.929453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbcf5-42a1-41ba-b9c7-e688ccc8154c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:24.929577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbcf5-42a1-41ba-b9c7-e688ccc8154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:24.947914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26dcbcf5-42a1-41ba-b9c7-e688ccc8154c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:24.949368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26dcbcf5-42a1-41ba-b9c7-e688ccc8154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:25.052342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 223/482] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:25.059206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0348-1e70-4cbc-9288-291a1fef2aed None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.059499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0348-1e70-4cbc-9288-291a1fef2aed None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.059807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0348-1e70-4cbc-9288-291a1fef2aed None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.061612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 260/483] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:25.066759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.067056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.067338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.085162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:25.086346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:25.089888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0348-1e70-4cbc-9288-291a1fef2aed None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.206462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 224/484] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:25.225215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0348-1e70-4cbc-9288-291a1fef2aed None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.231954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.234409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:25.277819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.278994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.279478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.279951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.292362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:25.302151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:25.303576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:25.304363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:25.307394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 261/485] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:25.314407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.380978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:25.447704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f19cd-8bf6-4291-bd12-d59e6dca3b45 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.520429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.521177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.521494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.522355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.527324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4798-cc94-4de5-b72c-798a171eef38 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.548445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:25.563415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:25.564377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:25.565220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:25.569735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 225/486] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:25.575554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.588983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1260-2992-45c5-944c-151982c1744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.590049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1260-2992-45c5-944c-151982c1744a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.590540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1260-2992-45c5-944c-151982c1744a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.591033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1260-2992-45c5-944c-151982c1744a None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.591992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1260-2992-45c5-944c-151982c1744a None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:25.592608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1260-2992-45c5-944c-151982c1744a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:25.594303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1260-2992-45c5-944c-151982c1744a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:25.604570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 262/487] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:25.616221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1260-2992-45c5-944c-151982c1744a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.671751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:25.726697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee5e2-c316-4b4e-baa6-da681f3f9de7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.736658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1260-2992-45c5-944c-151982c1744a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.772027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.772820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.773108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.773391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:25.773499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.774126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:25.774430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:25.774691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.775704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.775881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaca32-9a76-49f1-b75c-56ef85758440 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:25.776354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.776883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.785006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 226/488] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:25.786305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0cee9-ab27-483a-adb5-28fd90012865 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.786789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0cee9-ab27-483a-adb5-28fd90012865 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.786904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0cee9-ab27-483a-adb5-28fd90012865 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.788859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:25.790448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:25.792321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 227/489] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:25.793597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17a7c-5583-4b26-8731-b39a4feeb126 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.793883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17a7c-5583-4b26-8731-b39a4feeb126 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.794156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17a7c-5583-4b26-8731-b39a4feeb126 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.795435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 228/490] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:25.796119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c17a7c-5583-4b26-8731-b39a4feeb126 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-431da853-1e56-4487-8d6f-59309e5c3ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:25.810446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:25.811325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:25.812153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:25.812153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:25.812153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:25.812153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:25.814148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 263/491] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:25.815462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46630-c46b-4bc0-b167-53560610e8ad None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.815759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46630-c46b-4bc0-b167-53560610e8ad None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.816039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46630-c46b-4bc0-b167-53560610e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.834711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-98f46630-c46b-4bc0-b167-53560610e8ad None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:25.836053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-98f46630-c46b-4bc0-b167-53560610e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:25.908998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c17a7c-5583-4b26-8731-b39a4feeb126 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:25.911988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 264/492] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:25.917826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.918118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.918398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.938808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:25.939297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:25.940076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:25.950512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:25.952069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:25.952069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:25.952069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:25.962476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:25.964094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:25.983554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:25.984399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:25.985396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:25.985396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:25.985396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:25.985396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:25.987662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 229/493] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:25.988613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.020702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 265/494] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:26.020702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.040446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.104016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc841e-f51e-45ff-86b7-fb3736227d51 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.130906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfc38e-e6f1-46af-acf3-80ef9b4ee3b6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.141253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.142200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.142512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.142942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.143798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:26.144110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.146046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.162574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 230/495] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:26.163426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.169785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.170658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.170956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.171237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.183654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:26.191327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:26.192180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 266/496] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:26.193464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.206200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.267161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.277361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383f16-4eb8-4574-a7ac-cabd60e0d93b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.300351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193612-ffb5-433a-8123-4e706c2cd356 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.312703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.313372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.313658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.313932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.314745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:26.315060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.316439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.329046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 231/497] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:26.329882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.343521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.344689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.345152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.345722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.357511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:26.366679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:26.367540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:26.368344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 267/498] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:26.369004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.436621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.443817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ffa52-2f8f-4303-bd16-a9e5cc9ed3aa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.479841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27dc8-5d98-442b-b25a-d1f1f8ec4b7e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.487970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725717d-ff42-432e-9866-fca31681595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.489203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725717d-ff42-432e-9866-fca31681595f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.489489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725717d-ff42-432e-9866-fca31681595f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.489764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725717d-ff42-432e-9866-fca31681595f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.498829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725717d-ff42-432e-9866-fca31681595f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.500216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725717d-ff42-432e-9866-fca31681595f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.511125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1725717d-ff42-432e-9866-fca31681595f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:26.516209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:26.517188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:26.524461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:26.525036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.525123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 232/499] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:26.525199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.525199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.525332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725717d-ff42-432e-9866-fca31681595f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.525398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.525398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:26.525398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.525398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.535462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 268/500] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:26.535462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.630616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725717d-ff42-432e-9866-fca31681595f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.637194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979d340-0c95-4784-9247-596a70bba2a9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.668945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.669748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.670033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.670308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.671978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.672680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.672955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.673236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.674120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:26.674428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.675810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.679818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.681892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.684624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 269/501] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:26.685418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:26.702385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:26.703356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:26.704217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:26.706000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 233/502] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:26.706927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.730252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.753836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.801535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d707c-07a0-405d-904c-12dfb96d6cb6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.821326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac7071-1da9-4bc9-aa49-bb0d5d66da21 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.836693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.837363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.837648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.837917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.838747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:26.839048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.840472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.854722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:26.855525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:26.855808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:26.856082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:26.868620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:26.870090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:26.877134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 270/503] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:26.877972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:26.893037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:26.894086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 234/504] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:26.895027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:26.962065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:26.989347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256cd79-57db-427e-a378-4c87b30ff799 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:26.994269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18b42-6357-48aa-96b5-f1ddd36fbb09 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.002979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.023776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.024647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.024933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.025207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.027446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.028104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.028382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.028693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.029524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:27.029826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.031259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.034962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.036464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e3344612-2ff7-4119-97ed-d49860f08c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:27.055559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:27.056398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:27.057276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:27.057276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:27.057276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.057276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:27.057276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 271/505] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:27.058073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64665-4478-4c2a-8d81-360c530ce527 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.058240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64665-4478-4c2a-8d81-360c530ce527 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.058517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64665-4478-4c2a-8d81-360c530ce527 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.059759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 272/506] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:27.060452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64665-4478-4c2a-8d81-360c530ce527 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.074982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 235/507] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:27.078301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.164128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64665-4478-4c2a-8d81-360c530ce527 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.174741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accd4e-0d7c-483b-bd39-3ed864748247 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.197159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.197807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.198090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.198443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.223005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.229558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.233376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.238327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.250498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 236/508] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:27.251318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.270194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.272210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5cbbd-f1f4-4008-bcb3-1078ea26212d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.350940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b721e-2ae6-47b8-b21d-5a8180e1df5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.369816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 273/509] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:27.371105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.371396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.371678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.383218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.383877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.384159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.384432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.385192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:27.385497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.387131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.387798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:27.389058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:27.399343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 237/510] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:27.400149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.445663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.450593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.458276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 274/511] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:27.459591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.500349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d486-417f-4cee-8f01-6424ba8e6b18 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.533621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.534267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.534553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.534833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.562365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739bc0-34ec-41ad-8eee-a4aaa3f23320 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.595438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.596231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.596524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.596796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.601791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.603270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.603897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.605377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:27.621353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:27.622243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:27.623124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 275/512] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:27.623676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.652049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.682424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.706042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 238/513] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:27.706808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.727452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d58f-6baa-4f89-897d-564b5e278ffd None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.760398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.761475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.761753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.762023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.772237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.773745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:27.790961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:27.791811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:27.792683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:27.792683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:27.792683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.792683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:27.792683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 276/514] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:27.792948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.809420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e753d-faf7-4c52-b03e-48b552bca8e0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.842460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.843249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.843537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.843804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.851467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.852938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:27.867963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:27.868890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:27.869765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 239/515] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:27.870548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.879163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.896944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f08b2-38d5-48fe-b56b-2b9c2a6f6279 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:27.906569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:27.931965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:27.932877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:27.933167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:27.933443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:27.944934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:27.946407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:27.964013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:27.965036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:27.965920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:27.965920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:27.965920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:27.965920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:27.965920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 277/516] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:27.966367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:27.975053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d30f-9307-456b-8655-ad7d5d45b642 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.009646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.010315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.010857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.011143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.011980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:28.012287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.013786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.030800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 240/517] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:28.031596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.067619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1be7c-7f03-41ea-aa4f-f69f8f131b6f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.096672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.101173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.101962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.102243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.102517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.114974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.117029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.133809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967ec2-68f5-4b04-b1f2-6e10982d8fb2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:28.134278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:28.135218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:28.136321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:28.136321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:28.136321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:28.136321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:28.136321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 278/518] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:28.136618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.149156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.171539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.172196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.172477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.172783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.173496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:28.173803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.175177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.187333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 241/519] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:28.187959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.235490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7783632-4477-423e-a6a8-a23a15987cec None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.268915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.269589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.269870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.270154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.270980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:28.271325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.272790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.287511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbaee-0bf9-42e5-8408-104b99fc3fb4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.289186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 279/520] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:28.289979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.316618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.327559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.340750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.342121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 242/521] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:28.342901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.354743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.389165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b197-db03-48fe-94af-63d4cff74832 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.422761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.423402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.423692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.423965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.442659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6554a-4d5a-4cf2-8db7-9510e4574df7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.475599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.476253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.476628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.476905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.477629 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:28.477931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.479298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.491249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 243/522] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:28.491983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.508076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.511103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.549400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.575757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.606016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eed2d-f5ef-4383-b058-0028f2168d19 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.609100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 280/523] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:28.609927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.639578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.640365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.640746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.641021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.647575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.649064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:28.664257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:28.665155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 244/524] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:28.666556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.711826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86310c-2231-423b-953a-918c8ae1f262 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.745911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.746541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.746822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.747123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.763033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850600-35a4-4d56-9766-918ee7c3b407 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:28.765577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.781721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:28.796971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:28.797641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:28.798057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:28.798625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:28.799330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.800789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.814430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:28.815887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:28.888407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 245/525] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:28 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:28.889264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:28.939482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 281/526] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:28.940381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.016103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.019232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b291ca0-36eb-4f4f-801c-236af865e711 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.055257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524f56-d50c-41ca-8fe1-8c484437f66f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.058020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.058818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.059104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.059374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.068265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.069848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:29.087489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:29.088369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:29.089326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 246/527] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:29.089810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.102406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.103340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.103619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.103889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.114874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.117097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.118989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:29.135153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:29.141461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 282/528] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:29.142287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.209683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c8ed5-aa7c-4d08-bf53-8ba34366187f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.243584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241b56-6aaf-4653-b655-94bbb585cf64 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.245414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.246078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.246353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.246617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.247406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.247711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.249192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.266972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.268635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 247/529] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.269481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.284904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.285706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.286028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.286534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.297474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.298940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:29.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:29.318117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:29.319283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:29.319283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:29.319283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:29.319283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:29.322007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 283/530] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:29.322719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.360838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.382645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deaf75-7db5-4b07-95c3-5daf8b6d2e26 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.424885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.425951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.426494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.426948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.428425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.429037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.430802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.432307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef31e8-679b-40c5-b18a-94e97721503f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.443760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 248/531] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.444696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.470860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.471529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.471810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.472091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.472875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.473185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.475076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.487313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 284/532] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.488133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.520186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.555995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a05d0-bc95-4c21-aee1-a2d4f7cd963b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.590305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.590938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.591221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.591496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.592332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.592516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900fe5-b97b-4fda-8841-86b0d9cb7d9d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.592678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.594116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.608525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 249/533] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.608525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.612838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.647825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.648823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.649208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.650552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.651453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.651872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.653478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.672822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 285/534] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.672822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.730226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd05d-156f-43d9-aa63-1f78fa57b61a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.768092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.768949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.769235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.769507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.771945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=abab3be86e7f48ad8cfc406f4c6c988d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:29.772255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.773805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.783798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 250/535] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/role_assignments?user.id=abab3be86e7f48ad8cfc406f4c6c988d&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:29.784653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:29.808700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.822376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd3c3-8643-4d30-b89f-71cb4a2d796a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.875573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:29.905853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:29.906400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:29.906867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:29.907143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:29.920701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:29.922197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:29.956642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ceb-32ca-4677-b98a-2c3464f9b106 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:29.962178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:29.963251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:29.964299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:29.970408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 286/536] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:29.978950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:30.039807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:30.040319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:30.040319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:30.044536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:30.061078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:30.062757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:30.097444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:30.098589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:30.099711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:30.110484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 251/537] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:30.122109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:30.164951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfa107-1935-4544-944f-2b16b62720fe None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:30.223765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:30.225662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:30.226148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:30.226639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:30.227619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:30.228128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:30.230216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:30.270323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 287/538] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:30.277028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:30.294257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:30.305195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30ba7-2a17-4479-9247-d621146fe218 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:30.354848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:30.373210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:30.373882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:30.374163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:30.374437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:30.375351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:30.375663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:30.377268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:30.394557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033012-bfd7-4ea0-8284-7a70f3f20f0c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:30.396742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 252/539] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:30.405485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:30.444906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:30.445816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:30.446262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:30.446675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:30.447816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=8ec5d01659b2451fbbd9e2d5647b9b79) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:30.448391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:30.449994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacfc59-6277-473f-a66e-944ae29dd6ad None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:30.461175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 288/540] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:30 2022] GET /identity/v3/role_assignments?user.id=8ec5d01659b2451fbbd9e2d5647b9b79&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:30.595065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a4acc-2ca6-4cef-8a95-1431142a8fca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:30.636267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:30.637255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:30.637713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:30.638127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:30.639108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=8f74aa6096fb4f1aa6f239f39b670712) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:30.639559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:30.641200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398bbf-c743-41e6-8f7c-4caa67f5ee2e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:30.649001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 253/541] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:30 2022] GET /identity/v3/role_assignments?user.id=8f74aa6096fb4f1aa6f239f39b670712&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:31.142056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25b0-fcb5-4722-b1b6-1ad99080b5c0 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:31.142430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25b0-fcb5-4722-b1b6-1ad99080b5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:31.142610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da25b0-fcb5-4722-b1b6-1ad99080b5c0 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:31.144181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 289/542] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:31.150501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:31.150994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:31.151066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:31.179078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:31.180270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:31.250289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:31.278448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 254/543] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:31.313112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da25b0-fcb5-4722-b1b6-1ad99080b5c0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:31.438171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:31.490737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da25b0-fcb5-4722-b1b6-1ad99080b5c0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:31.597224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:31.598056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:31.598339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:31.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:31.629416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:31.637597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:31.638459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:31.639246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:31.644995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 290/544] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:31.652577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:31.870366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866373-b070-46a2-bfe7-a7cb77a3f425 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:31.942524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:31.943578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:31.944063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:31.944585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:31.945577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:31.946105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:31.947672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:31.960588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 255/545] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:31.965577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.182479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4536a9-2e36-4ee7-aac5-a8ebdfd837f5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:32.251409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:32.252658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.253167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.253644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.261923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:32.276731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:32.278542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ea528c21-60e9-4649-8ea1-f801b652a067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:32.301197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:32.303106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:32.304021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:32.304021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:32.304021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:32.304021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:32.311745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 291/546] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:32.313690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.324655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbabee3-849b-40f2-bc4c-6a87bd834574 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.327025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbabee3-849b-40f2-bc4c-6a87bd834574 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.327744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbabee3-849b-40f2-bc4c-6a87bd834574 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.331741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 292/547] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:32 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:32.336148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.336733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.337215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.365710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:32.370189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:32.395924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:32.474645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 293/548] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:32.506415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f09d-77ba-4ae6-8017-3f0e12d2fe85 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:32.515910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.557275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:32.560513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.560513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.560513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.560513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:32.560513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:32.566277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:32.591943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 256/549] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:32.598225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.703193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2d13a-f2f9-4a6e-9a9f-7d6b21d2a2ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:32.705558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:32.720197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66fc09-7a61-45df-84d9-cad7fe3cc30d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:32.738976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:32.739743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.740152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.740438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.740824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:32.748222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:32.749651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:32.760848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:32.762048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.762545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.763021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a80c0411-0e5f-4c8e-9e40-6dd8c588ca8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:32.765910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:32.766798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:32.768162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:32.772571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 257/550] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:32.773785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08035-3ccc-4a59-9e88-6e2bc9ad6c0b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.774076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08035-3ccc-4a59-9e88-6e2bc9ad6c0b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.774351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08035-3ccc-4a59-9e88-6e2bc9ad6c0b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.779909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 258/551] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:32.779909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb08035-3ccc-4a59-9e88-6e2bc9ad6c0b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.785033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-42c7a73e-3daa-4394-a3cf-1786900dff36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:32.795513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:32.796441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:32.797294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:32.800186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 294/552] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:32.801903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.802664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.803260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.823594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:32.826116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:32.884575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb08035-3ccc-4a59-9e88-6e2bc9ad6c0b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:32.920430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:32.920835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 295/553] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:32.921096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:32.921662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:32.921938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:32.922685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.922804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:32.923082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:32.924531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:32.946867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 259/554] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:32.952250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:32.980300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.057203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a531-4bed-4a83-81b4-625d9d25548e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.061848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac27e-bdb8-4d99-a40f-bb39a3afdf7d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.078435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.095464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.096122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.096444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.096710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.104798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.105841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.106436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.107006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.107976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:33.112791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.112791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.120657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 296/555] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:33.121950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.173973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.175597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.203823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.241785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3733-477f-4a6d-b7c8-b7bd01174a1b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.281208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.282026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.282307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.282585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.291458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 260/556] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:16:33.292711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.296459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-a10dcb91-122f-4e4f-8f31-5ac06c77259b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:33.304852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:33.306684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 297/557] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:33.308342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b9e-f3c2-4b46-b6de-17d78013d4a4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.310341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b9e-f3c2-4b46-b6de-17d78013d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.310341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b9e-f3c2-4b46-b6de-17d78013d4a4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.312849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 298/558] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:33.315065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8b9e-f3c2-4b46-b6de-17d78013d4a4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.346353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.398887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034af7-b2d9-402c-a9a6-8d0b056ea698 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.415780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8b9e-f3c2-4b46-b6de-17d78013d4a4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.421281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.434857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.437537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.437537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.437537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.449375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.450862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.452751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.454116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.454624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.455128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.466880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.468624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e1db2a71-a538-4db0-8102-50a7338fce1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:33.470746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:33.471632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:33.472507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:33.472507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:33.472507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:33.472507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:33.472507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 261/559] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:33.473479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41c61-608c-4210-a57d-6af8dd78b7b1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.473756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41c61-608c-4210-a57d-6af8dd78b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.474056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41c61-608c-4210-a57d-6af8dd78b7b1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.475426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 262/560] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:33.476438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.476986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.477263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:33.493403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:33.494460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:33.495320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:33.495320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:33.495320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:33.495320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:33.495532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:33.495601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 299/561] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:33.495666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:33.495740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.560874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 263/562] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:33.561642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.582607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.602937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2d5f-6b14-4db2-84b1-7074f90ab9f1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.640780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.641453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.641730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.642000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.642742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:33.643045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.644674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676beac8-74dd-4577-92da-ab27ef528808 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.653074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 300/563] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:33.654414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.654699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.654968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.673392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:33.675282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:33.688294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f54e2-f8ef-42a6-b329-48202350154f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.690784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.722125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.722786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.723064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.723343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.724630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:33.724931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.726387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.737951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 264/564] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:33.740035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.757263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 301/565] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:33.758419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.844986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:33.867899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9292e4-46d7-4517-9cb6-781d7b9b2f5c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.871811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13de0-e6c2-49d5-be89-ce5bffc2f1a4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:33.906874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.908166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.908449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.908756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.909586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:33.909885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:33.911250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:33.912148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:33.912989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:33.913262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:33.913529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:33.923885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:33.925457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 265/566] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:33.926342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:33.933190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:33.934331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 302/567] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:33.935231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:33.955604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.050217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4c021-0310-4df8-8e22-ba474717b40d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.058737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ac0b-65be-42de-8d09-ddc5eb20eca5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.088348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.089277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.089546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.089815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.099816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.100649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.100939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.101218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.102087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.103330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.104726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.111469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.114145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:34.123692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.124659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.125617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:34.125617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:34.125617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:34.125617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:34.125617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 266/568] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.126188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:34.133069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.134434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 303/569] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.137306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.218198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.249626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bc53-7072-4378-b465-2538dd5c088a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.250921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8045c-834f-499e-baa6-2a929dfb4435 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.288323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.289187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.289503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.289831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.292242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.293072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.293352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.293623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.297018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.298461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.304271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:34.314436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:34.316201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:34.317365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.318851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:34.319691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:34.320204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 267/570] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.320204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.320325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 304/571] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.320325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.390843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.431062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97880ea-3ec0-4305-8109-4d7228f22f97 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.433791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f175-d88f-44ce-b6d0-46a2ff869fa7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.465490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.466182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.466466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.466746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.467499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:34.467808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.468671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.469207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.469336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.469616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.469891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.470608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:34.470910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.471344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.472286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.478083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 268/572] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:34.478965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.486075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 305/573] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:34.486239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.583153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162be7b5-3767-49a7-887e-3fbd26e97beb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.598786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa9a3-7863-4350-9893-9eb0a210bf48 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.612628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.617044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.623316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.639899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 269/574] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:34.640761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.640999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.641646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.641934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.642214 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.643007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:34.643334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.645001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.657593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 306/575] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:34.658482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.698144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.743098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701700e4-b40e-45b1-a5ad-8c75d01724da None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.759694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948151-9536-41d5-964b-8337d832aac1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.776920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.777588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.777912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.778137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.778879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:34.779184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.780561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.788422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 270/576] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:34.789246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.795844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.796688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.796977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.797254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.808600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.810039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:34.827250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.828268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.829373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:34.829373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:34.829373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:34.829373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:34.829373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 307/577] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.829682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.855987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.894269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266c5ce-8429-45d3-9854-550886a954b3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.911909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:34.929416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.930213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.930495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.930771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.931518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e4cc-d91f-48fb-a902-2df638c2efd0 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:34.939046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.940513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:34.955948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.957061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:34.958062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 271/578] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:34.958716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:34.968086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:34.968914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:34.969198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:34.969476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:34.979420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:34.980892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:34.998897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:34.999750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.000642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:35.000642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:35.000642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:35.000642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:35.000642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 308/579] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.000926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.066615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e179d0-b468-431b-8a8f-d993d1d7ee1d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.082417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.102826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08d3b-2b59-44d4-8a90-d6786295d1d7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.104968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.105619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.105900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.106174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.107006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=aad40b6b9b26414a9d87746b77c9e560) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:35.107314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.108766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.128515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 272/580] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:34 2022] GET /identity/v3/role_assignments?user.id=aad40b6b9b26414a9d87746b77c9e560&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:35.128515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.140568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.141396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.141680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.141958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.153791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.155222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:35.175083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:35.176229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.177982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:35.177982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:35.177982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:35.177982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:35.180837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 309/581] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.182478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.183360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.248276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ecb16-0a57-473a-b727-e5d45ea17941 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.287387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.288365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.288736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.289009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.289733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:35.290037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.291404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.298232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c53b-97b9-4457-b64a-6b450d2bc7a6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.303836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 273/582] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:35.304886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.330408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.336248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.336950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.337231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.337507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.344466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:35.344466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.344466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.362042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 310/583] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:35.362042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.433207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c340b9-4dd5-464e-98ce-b962f87413ee None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.435416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.467824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787417d6-1ac9-4368-ba9d-84e74d5c2a20 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.469980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.470814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.471150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.471771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.472514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:35.472840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.474755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.491336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 274/584] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:35.492356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.507826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.508553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.508840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.509115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.509834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:35.510141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.511781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.528779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 311/585] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:35.529664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.580307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.601246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063c64-f0fc-4d61-a930-dd5aaaecb572 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.634058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5be01-356f-44fb-b231-de2742f3b6d6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.637076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.637871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.638152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.638421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.646737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.648168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:35.663042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:35.663970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 275/586] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.665538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.674930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.675922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.676063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.676279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.688344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.689793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.691669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:35.707529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:35.709248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 312/587] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.715396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.779506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3180ad-ece2-4e14-974c-3f2758d84803 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.815102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.815901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.816183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.816535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.823363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.824445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.824823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.827732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc000-5584-4698-8d03-6b313a9fd813 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:35.839404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:35.840339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:35.841260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 276/588] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.841743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.868236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.869424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.869891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.870172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:35.877906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:35.879358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:35.894621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:35.895607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:35.896665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:35.900509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 313/589] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:35.901397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:35.938925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:35.957891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e188-b618-40c9-8ec2-fb0df054aad1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:35.998078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:35.998865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:35.999210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:35.999551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.000398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.000894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.002147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.007346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdddf2-9f75-4b3e-9f5d-b324200327a4 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.020679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 277/590] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.022191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.048929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.049596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.049884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.050159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.050903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.051216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.052841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.068538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 314/591] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.068874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.094318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.136125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059c8e9-c91d-4334-adba-5e8258ffca86 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.172797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.173461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.173745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.174023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.174838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.175147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.176675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.180402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf408a-74b2-4f94-b3f3-49f5e0f8153c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.186595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.190229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 278/592] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.191001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.224753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.225470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.225749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.226024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.226919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.227234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.228690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.251742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 315/593] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.252654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.297130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19624f0-815e-4604-90c6-66a575fab896 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.333131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.334482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.334765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.335042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.338105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.346031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.347501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.359853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797b2d9-665b-4246-9e1d-ed82db34f223 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:36.366212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:36.367105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:36.367988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:36.367988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:36.367988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:36.367988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:36.367988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 279/594] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:36.368268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.399827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.400659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.400958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.401222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.407872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.409346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:36.423746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:36.424656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:36.425525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 316/595] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:36.425989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.432116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.483179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd033-4ba9-46b7-a10a-777ba80d77a3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.518181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.519099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.519383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.519659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.534508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=d125909b383a44b49e94715bde34866c, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.535956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.536060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246abc18-a266-45d4-be21-4817aec2ec28 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.571143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.571962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.572265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.572574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.580468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.585832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.587287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:36.604781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:36.605859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:36.607014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:36.607014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:36.607014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:36.607014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:36.607444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 317/596] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:36.608291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.624518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 280/597] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:36 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:36.624518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.734440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a03d1-1c14-4ca6-812d-9a059a4d1d10 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.736120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.762781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f3ba-5985-4d7d-ab7b-72367aa27266 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.773409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.774092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.774376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.774652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.775464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.775771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.777420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.794807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 281/598] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.794807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.810907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.811683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.811865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.812130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.812891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.813198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.814579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.831021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 318/599] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.831666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.894351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:36.921028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88637ccb-674a-4ff8-a96d-4d944af63683 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.955816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2cfb3-d9a7-4fe2-bfe2-a15ecc52368a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:36.967560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.968274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.968583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.968858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:36.970002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:36.970307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:36.971978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:36.989196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 282/600] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:36.991229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:36.997285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:36.998762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:36.999260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:36.999739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/abab3be86e7f48ad8cfc406f4c6c988d/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.017021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=abab3be86e7f48ad8cfc406f4c6c988d, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.018996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.020125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.099013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 319/601] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:36 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/abab3be86e7f48ad8cfc406f4c6c988d/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:37.100852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.110070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3339-727f-4ca0-9a6c-613ad59f9699 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.193663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.194609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.194899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.195172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.213835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.215707 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f8a0326e-4cc1-4081-86f5-1af36fdd89c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:37.242315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:37.243236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:37.244101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:37.247305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 283/602] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:37.248292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.249372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a7d9-4e61-4087-ab14-852987a0d5dc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.249638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a7d9-4e61-4087-ab14-852987a0d5dc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.249916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a7d9-4e61-4087-ab14-852987a0d5dc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.251262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 284/603] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:37.252331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd451f-0563-4c4b-8c80-40044ccbc0c7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.256519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a7d9-4e61-4087-ab14-852987a0d5dc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.294973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.295787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.296065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.296347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.303914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.305417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8e0509bd-7fe2-4618-b641-3f9eebd0a73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:37.320839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:37.321780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:37.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 320/604] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:37.323291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.323574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.323855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.341575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:37.342766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:37.368556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.395074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a7d9-4e61-4087-ab14-852987a0d5dc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.428265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 321/605] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:37.429213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.460467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.461593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.461877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.462153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.463015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:37.463323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.465626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.483091 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 285/606] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:37.484597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.537952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.547947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffac38-c8ce-44a3-852f-a8315843a4d4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.594176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.595525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.596016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.596470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.597731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:37.598373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.601286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.608068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a60e-c858-4fe2-93c3-2e4307776c0d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.617101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 322/607] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:37.618547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.643797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.644733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.645169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.645404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.656589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:37.664741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:37.665693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:37.666557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:37.670908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 286/608] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:37.671800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.685933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.755221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae58968-d1fc-4812-884c-f6295109d17f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.780469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc06d-7e12-4e1c-b5dd-fb482e987697 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:37.803272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.804168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.804954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.805310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/8ec5d01659b2451fbbd9e2d5647b9b79/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.821060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:37.822341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:37.822762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:37.822946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=8ec5d01659b2451fbbd9e2d5647b9b79, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.823340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/8f74aa6096fb4f1aa6f239f39b670712/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:37.824578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.841826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=8f74aa6096fb4f1aa6f239f39b670712, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:37.843588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:37.918949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:37.928529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 323/609] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:37 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/8ec5d01659b2451fbbd9e2d5647b9b79/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:37.928529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:37.969277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 287/610] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:37 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/8f74aa6096fb4f1aa6f239f39b670712/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:38.066353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a9c1-71bf-4f7e-b2d8-271303ad6aec None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:38.121485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:38.122330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:38.122680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:38.123020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:38.123917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:38.124292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:38.125999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:38.142290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 324/611] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:38.148037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:38.210229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:38.259790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990814c-0adf-491c-9924-e5c0dc2d980c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:38.300267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246088-5096-4921-9a05-823628c70b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:38.301109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246088-5096-4921-9a05-823628c70b9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:38.301388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246088-5096-4921-9a05-823628c70b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:38.301666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246088-5096-4921-9a05-823628c70b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:38.313218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246088-5096-4921-9a05-823628c70b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:38.314850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246088-5096-4921-9a05-823628c70b9b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-20246088-5096-4921-9a05-823628c70b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:38.339828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:38.340793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:38.341653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:38.341653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:38.341653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:38.341653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:38.341653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 288/612] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:38.347023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:38.422058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:38.471106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62f0d-42f6-4c91-9757-e721b7edcaaa None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:38.522258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:38.522941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:38.523224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:38.523498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:38.524223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:38.524549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:38.526100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:38.542643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 325/613] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:38.548084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246088-5096-4921-9a05-823628c70b9b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:38.682717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246088-5096-4921-9a05-823628c70b9b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:38.685079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:38.724695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:38.725491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:38.725770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:38.726042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:38.739860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:38.741372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:38.758674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:38.759626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:38.760847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 289/614] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:38.766094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:38.886313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83044e3d-bb27-461e-a603-299361618c26 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:38.922999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:38.938955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:38.938955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:38.939180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:38.939271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:38.940075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:38.940381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:38.941960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51990282-8684-4b22-8aee-18fa7f58c185 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:38.967390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 326/615] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:16:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:38.973208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.108116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276f4d-7fbb-4340-82e7-a48744790a73 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.163230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.164390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.165002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.165492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.173021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62f62-9193-419c-987f-a5504d6d9634 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.173310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62f62-9193-419c-987f-a5504d6d9634 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.173594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62f62-9193-419c-987f-a5504d6d9634 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.175286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 327/616] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:39.181604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:39.183282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:39.185791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.186079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.186375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:39.201972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:39.202876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:39.203889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:39.203889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:39.203889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:39.203889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:39.206192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 290/617] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:39.212674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.213778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:39.217361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:39.244842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:39.353916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 328/618] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:39.373463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aa74c-6978-4eff-8263-3ff0df0613b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.395109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.431325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.431994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.432270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.432559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.433286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:39.433585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:39.434946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:39.456284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 291/619] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:39.462398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.576619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4794a-fea7-4820-b19b-4c95a8a91c1e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.588881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:39.600875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:39.614005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ac520-6666-4a37-a846-6c5586570143 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.655688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.656480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.656784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.657054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.665062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.665241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:39.665874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.666160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.666435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.666539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:39.684915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:39.685863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:39.686733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:39.687169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 292/620] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:39.693405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.697382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:39.713387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:39.714298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:39.715185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 329/621] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:39.720451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.846334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae27e3-609c-4b40-83b4-a52a5bed571f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.886036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.886792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.887076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.887351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.888238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:39.888570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:39.889991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555abc12-9bd4-4368-98fc-0899203c677f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:39.892719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:39.895187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b8ee-b5d6-47e1-b991-2cbb63ed5d1c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:39.904301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 293/622] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:39.905964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668cf7-6838-4da9-8096-b710a89999b5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.906078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668cf7-6838-4da9-8096-b710a89999b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.906351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668cf7-6838-4da9-8096-b710a89999b5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.912237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 294/623] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:39.912237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e668cf7-6838-4da9-8096-b710a89999b5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:39.939882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:39.941104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.941609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.942082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.943242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:39.943775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:39.945374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989b19e-a6c2-4bb8-ae41-07ca641af823 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:39.954399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 330/624] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:39.955890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:39.956378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:39.956891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:39.975183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:39.976921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:40.005626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.026432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e668cf7-6838-4da9-8096-b710a89999b5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.056821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 331/625] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:40.058120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.068205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.068205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.068205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.068205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/aad40b6b9b26414a9d87746b77c9e560/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.084538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=aad40b6b9b26414a9d87746b77c9e560, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.084538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.162830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 295/626] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:39 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/aad40b6b9b26414a9d87746b77c9e560/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:40.163667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.189431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eb191-341e-4e64-a2f6-7e9d6540c059 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.236872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.238045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.238546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.240135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.253116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.254974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.266179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:40.280248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:40.281272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:40.282134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:40.282134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:40.282134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:40.282134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:40.285561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 332/627] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:40.294410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.333992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.374221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ad296-ae21-4678-9eee-886e73a5081d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.419010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.420181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.420466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.420815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.436212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:40.447744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:40.448790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:40.449626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 296/628] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:40.457147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.484349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a24ed-6fa0-46a0-a52b-6d6388912432 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.525546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.526133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.526529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.526809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.527526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:40.527830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.529355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce473-a72e-4105-807c-3a60a8ed8347 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.545807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 333/629] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:40.547347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f8e2-de3a-454a-b200-bd6f735225ba None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.547627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f8e2-de3a-454a-b200-bd6f735225ba None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.547901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f8e2-de3a-454a-b200-bd6f735225ba None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.549420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 334/630] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:40.551424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204f8e2-de3a-454a-b200-bd6f735225ba None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.589154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b69f-e1c2-430b-a10b-562abf46f18c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.597901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.645983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.653151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.653818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.654092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.654360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.655105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:40.655403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.656796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994689e0-2beb-4678-93cc-f54b530f2230 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.669082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 297/631] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:40.670638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.670752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.670993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.683315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204f8e2-de3a-454a-b200-bd6f735225ba None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.691480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:40.693352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:40.731435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.732227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.732571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.732845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.741783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.743241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:40.759905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:40.761235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:40.762187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 335/632] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:40.762772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.790469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 298/633] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:40.790469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.892368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c426f5-4d00-4915-9cee-c1fdf5bbb51c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.921765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.925978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98d03-b052-4a41-8e13-7c7e084170bb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:40.931242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.937571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.937571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.937571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.937571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:40.943092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.944626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.960168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:40.960867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.961150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.961425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:40.961999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:40.962993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:40.964376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:40.964376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:40.964376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:40.964376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:40.964747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:40.964747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:40.964870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 336/634] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:40.964870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:40.968441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4793fe-3aaf-457a-87fa-442b1adf3e05 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 299/635] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913640f-939a-42f6-b3e5-9743efb720c1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913640f-939a-42f6-b3e5-9743efb720c1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913640f-939a-42f6-b3e5-9743efb720c1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 300/636] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:40.993313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913640f-939a-42f6-b3e5-9743efb720c1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.079812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37758a-3d0a-4026-9ce8-64ea4974ae4f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.104409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913640f-939a-42f6-b3e5-9743efb720c1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.116119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.116953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.117237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.117514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.127819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:41.136408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:41.137383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:41.138238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 337/637] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:41.139555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.144731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.145432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.146249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.146519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.147244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:41.147543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.148931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975754-d01a-40a2-82d8-0c7dd4ddc5b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.165247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 301/638] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:41.165247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.165247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.165247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.179132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:41.180306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:41.190939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.194678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.248360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 302/639] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:41.249385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.262885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667084-2dd1-42fe-bca9-af23a284a0a2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.299015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.299961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.300274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.300549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.358822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e81d06-2bf3-4cd7-bdf9-0f2fe6ab947e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.378734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.380945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.392910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.393508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.393851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.394138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.394893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:41.395200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.397748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.406569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 303/640] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:41.407844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.422655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.432673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.487539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 338/641] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:41.488529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.528635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39806fcf-7f05-40db-b59c-1315cf57ac2a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.562414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.563164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.563453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.563725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.571567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.573068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:41.587784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:41.588963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:16:41.590625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:41.593418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 304/642] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:41.594222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.611062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde173d-cc6a-4e18-839a-6847511c2c17 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.647290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.648090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.648374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.648686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.658647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:41.665936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:41.666978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:41.667942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 339/643] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:41.669246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.678881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.707110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4bcbc-9520-4c88-ad4e-397016922918 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.742285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.743438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.743722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.744000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.755357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.756823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:41.775820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:41.776738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:41.777802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:41.777802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:41.777802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:41.777802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:41.777802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 305/644] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:41.778080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.784068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c67d0-774e-400c-b267-01e395c9a885 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.820620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.821223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.821506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.821781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.832610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.834581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:41.853097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:41.854165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 340/645] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:41.855060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.896065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ff304-6153-4874-a6d1-a36fd501576e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:41.919807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.925478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:41.934277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:41.934951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:41.935224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:41.935497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:41.936334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:41.936669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:41.938123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:41.961845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 306/646] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:41.961845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:41.975286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a064-bb12-4930-8516-888e6ce096a2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.012555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.013240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.013523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.013797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.014541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:42.014846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.016209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.025004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 341/647] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:42.025792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.077613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6c23-93a5-4d9d-a28f-68bcf03412f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.113258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.113927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.114260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.114543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.115511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:42.115818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.117249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.134115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 307/648] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:42.134115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.140511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ba56-4da5-4df5-a328-e3c4c1e07ae3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.164572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.174047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.183009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.183982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.184582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.184874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.185602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:42.185919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.187794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.201238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 342/649] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:42.202327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.240320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441679a3-9ee1-4b22-a1bc-917bd79146c6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.275251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.275894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.276176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.276449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.309696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7449-14e3-414a-bc64-701688a8781f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.344412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.345244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.345536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.345812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.349645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.351093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.356898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.358332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:42.376328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:42.377272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:42.378137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:42.378137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:42.378137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:42.378137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:42.378137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 343/650] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:42.378433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.395159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.416562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.467864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 308/651] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:42.468780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.498971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6367495-7cd6-44f4-8004-943caa17eb0a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.535057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.535855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.536760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.537037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.544355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.545844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:42.560835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:42.562068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:42.563061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 344/652] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:42.563650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.583961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067673-2ce4-4989-a882-9647ed735d2d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.618613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.619466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.619748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.620015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.627352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.628832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.631258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:42.650047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:42.651153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:42.652709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:42.657935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 309/653] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:42.659512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.669875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.680027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46cc3-38b1-4f0f-b478-6f39bc2dcf8a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.715771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.716709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.716997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.717375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.718101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:42.718435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.720062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1e2ee-7d50-4d7d-be07-15678740e78d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.731521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 345/654] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:42.732812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c040-0fa1-4e16-8f9d-db09b92f6b7f None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.733103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c040-0fa1-4e16-8f9d-db09b92f6b7f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.733385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c040-0fa1-4e16-8f9d-db09b92f6b7f None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.734613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 346/655] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:42.735301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801c040-0fa1-4e16-8f9d-db09b92f6b7f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.777066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce1dae-74e2-40d0-97a4-c59f110743cc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.810895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.811689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.812022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.812237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.824129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.825803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:42.843808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:42.844777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:42.845635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:42.845635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:42.845635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:42.845635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:42.845870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801c040-0fa1-4e16-8f9d-db09b92f6b7f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:42.845945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 310/656] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:42.845945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.883056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:42.883730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:42.884006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:42.884277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:42.885149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:42.885709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:42.887151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:42.911949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 347/657] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:42.911949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:42.912187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.923877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:42.971011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4368b0-0c27-44df-a101-f1405fff96fa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.009827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.010747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.011018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.011286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.012087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:43.012397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.013946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258812c-734f-4ffc-ad0f-030cd590eea9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.026154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 311/658] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:43.027356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.027696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.027929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.031453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136a38-402f-450c-9402-9ae6ba7e330f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.047061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:43.048355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:43.074275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.075087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.075360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.075635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.083656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.085223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:43.100327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:43.101503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 348/659] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:43.102428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.121622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 312/660] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:43.122476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.164948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.182121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.213741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7aa3-b6c5-40e6-8b34-1688410e9010 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.221895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8454a-c483-49ab-bb8a-4557fa0fa347 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.247668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.248331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.248642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.248915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.249671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:43.249971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.251335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.257844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.258490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.258772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.259039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.263821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 349/661] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:43.264653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.326451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.327930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.362749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a7ed-fba4-4a23-b14c-b2abdc9cd905 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.367330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.391540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.397275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.397937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.398221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.398497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.399336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:43.399690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.401178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.407108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 350/662] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:43.407886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.436233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 313/663] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:43.437628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.528973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ed51-41e3-41d0-9759-cb4abb847cdf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.560525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed9f3d-180e-4990-be95-557fde75b50b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.565860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.566515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.566797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.567111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.568321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:43.568731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.570159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.590793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 351/664] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:43.592139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.607017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.607823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.608101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.608379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.617578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.620551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:43.629022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:43.643511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 314/665] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:43.644409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.760655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130087-fdd3-4916-8c83-60ee5a907fd2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.783284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.806445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.807356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.807646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.807919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.819086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.820697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.825609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dee60-8b5e-4517-b347-63b91326f33c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:43.839628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:43.840605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:43.841489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:43.841489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:43.841489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:43.841489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:43.841489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 315/666] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:43.842205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.870259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:43.871056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:43.871349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:43.871622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:43.878686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:43.880710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:43.896047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:43.897021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:43.897880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:43.902614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 352/667] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:43.903516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:43.908890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:43.958547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238d899-177c-4115-9394-9042e2bd50fc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.001959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.002895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.003177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.003599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.014875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cba35-a935-4ded-84f8-a5d75ac34a99 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.031835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.053884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.054570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.054856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.055133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.055890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.056199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.057627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.066911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 353/668] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.068474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.084158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.085703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.139497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.180727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7c04-f42a-432e-91da-021f51ab8d95 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.195488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 316/669] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:44.195488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.238288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.239764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.242199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.242199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.242199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.242199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.244849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.261598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 354/670] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.261598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.295733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.312313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec404ad-7b37-4798-80de-a5f542c38040 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.348121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.349772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.350058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.350448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.351249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.351563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.353022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.365117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 317/671] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.365907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.375442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8a6f-7b65-4238-acce-63f2deb2a4dd None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.380805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.414018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.414936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.415226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.415502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.425897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.428010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:44.447724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:44.448662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 355/672] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:44.454703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.468260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eda26-870a-46f1-b832-3584f81c36b1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.503296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.504084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.504373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.504721 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.515936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.517573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:44.535355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:44.536925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:44.537811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:44.537811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:44.537811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:44.537811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:44.537811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 318/673] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:44.538095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.548831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.563448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1562b-7737-45d0-9891-f8a7fb66493a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.606882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.607712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.607997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.608280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.617613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.619076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.627286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:44.634651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:44.640553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 356/674] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:44.641452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.683797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452fec-9939-452b-9fd8-2b76a0fdc3bb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.729992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.730970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.731260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.731694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.732580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=abab3be86e7f48ad8cfc406f4c6c988d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.732875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.734305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.740805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 319/675] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/role_assignments?user.id=abab3be86e7f48ad8cfc406f4c6c988d&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.741613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.771794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b966-4068-4820-a88c-2060e9b039db None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.811477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.812094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.812280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.812514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.813263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.813648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.815132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.835027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 357/676] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.836034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.846815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.898373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938540-0b5e-42e5-a45b-fd85a313b35e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:44.930882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:44.947569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:44.948246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:44.948566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:44.948842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:44.949571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:44.949873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:44.951231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:44.968599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 320/677] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:44.969761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:44.978552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba577-9cb5-4136-bfc5-70707678bcc8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.027651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.028319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.028633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.028887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.029981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:45.029981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.031392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.045695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 358/678] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:45.046532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.099453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4a64-b3fa-4670-9679-6c5651670ca9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.121913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.147172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.148595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.149225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.149990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.158347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.159930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.163064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a69fc9-c186-404e-a464-78abbc42136a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:45.176199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:45.177919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:45.178856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:45.179404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 321/679] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:45.180285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.214080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.215427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.216106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.216570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.228923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.230627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.243758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:45.252593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:45.257215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 359/680] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:45.258093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.305361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d083f7-bab5-40fe-af5b-f586a5295424 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.353033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.354318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.354670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.355035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.356223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=8ec5d01659b2451fbbd9e2d5647b9b79) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:45.356635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.359253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.368246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 322/681] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/role_assignments?user.id=8ec5d01659b2451fbbd9e2d5647b9b79&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:45.369409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.391971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410f568-f7e6-4ae6-8819-01d686d657c9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.423180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.432791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.433792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.434281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.434719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.435737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:45.436237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.437931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.462337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 360/682] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:45.469574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.508978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bcd10-4103-4dd4-951a-990b6a6ec93f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.526703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.552287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.553411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.554054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.554538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.555552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:45.556094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.557804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.573187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 323/683] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:45.579908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.671217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f8fbf-7119-4594-9b03-fa8ff9ed5d82 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.709902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.710898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.710898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.711158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.726244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a548df-ed7b-42ea-9e63-8cfd6679df6f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:45.771129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.771459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:45.772337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.772448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.772713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.773963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=8f74aa6096fb4f1aa6f239f39b670712) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:45.773963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.775971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b3f64-3a4a-4e3b-96f0-dfe9704d25c4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.783008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 324/684] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/role_assignments?user.id=8f74aa6096fb4f1aa6f239f39b670712&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:45.788637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff525-0b6d-4ee1-af55-222b296dac37 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.788637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff525-0b6d-4ee1-af55-222b296dac37 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.788637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff525-0b6d-4ee1-af55-222b296dac37 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.790010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 325/685] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:45.797060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:45.797509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:45.797978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:45.798205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:45.799870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:45.818609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:45.819997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:45.856004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:45.912811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 326/686] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:45.938087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 361/687] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:45.944817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:45.946937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.039547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.056743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573abeb8-cdeb-4eed-847b-633355f6b85d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.064605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c960919-2c4a-4fbd-9848-6369b64c6b3d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.094425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.095795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.096317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.096884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.103576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.104385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.104697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.104972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.111128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:46.117993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.119463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:46.120982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:46.121888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:46.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:46.131014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 362/688] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:46.132565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:46.142105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:46.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:46.144456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:46.144456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:46.144456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:46.144456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:46.144456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 327/689] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:46.149163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.175502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.263447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66986-abe3-48c3-a214-d76d1bf2d31a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.282335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6045de9-838c-4f75-b665-962c3cb094ae None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.300330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.301910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.302423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.302964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.303913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:46.304442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.306132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.320618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 363/690] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:46.321948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.322622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.322833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.322934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.323165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.323902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:46.324211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.325630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.334393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.340330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 328/691] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:46.345906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.432774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.435139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb016-3709-4b5c-9998-3543831a03eb None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.456040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce073875-b3cd-4731-b1e6-85afb8209a15 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.472921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.474233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.474761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.475205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.487129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.488965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.494360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.495291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.495678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.496054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.503517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.505798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:46.508881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:46.509896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:46.511031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:46.511031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:46.511031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:46.511031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:46.516669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 364/692] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:46.518704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:46.524119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:46.525228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:46.526322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 329/693] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:46.531462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.602978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.639641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341137e-9130-4392-a315-d4e6a3a4f1f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.678114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.679459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.679951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.680748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.681931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:46.682712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.682881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f25a-fc18-4c71-a644-c09a39c0c7f3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.685811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.699439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:46.705630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 330/694] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:46.711726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.755157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.755838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.756120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.756392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.757152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:46.757458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.758830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.788429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 365/695] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:46.794735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:46.863058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6c45-7557-49c1-9fcc-f3bb92959080 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:46.918814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:46.919478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:46.919757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:46.920030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:46.920891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=aad40b6b9b26414a9d87746b77c9e560) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:46.921202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:46.922640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:46.940032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 331/696] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/role_assignments?user.id=aad40b6b9b26414a9d87746b77c9e560&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:46.992653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410670c-60dc-43bd-8330-ca0e967c2005 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.013691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:47.032295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:47.033155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.033439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.033717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.042790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:47.044259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:47.061854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:47.064276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:47.065258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:47.068674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 366/697] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:47.070057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.141089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:47.196812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd752ab6-0ab2-4b80-bf80-18c9f0974538 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.233857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:47.234531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.234812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.235081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.235927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:47.236232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:47.237763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a906-a96a-46e5-a6f2-ee8c338e53cd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:47.263284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 332/698] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:47.268042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.381867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6952b9-bd32-457f-9d50-697e993df28e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.420553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b8a1-b109-41ed-b97d-0e8cca2dcdcf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.420743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b8a1-b109-41ed-b97d-0e8cca2dcdcf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.421005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427b8a1-b109-41ed-b97d-0e8cca2dcdcf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.422517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 333/699] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:47.428946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.429111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.429289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.430128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:47.431015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.431483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.432036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.455850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:47.457201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:47.487605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:47.511632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:47.513399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:47.555236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 334/700] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:47.583814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.644663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 367/701] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:47.646766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.653342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:47.706604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9c989-a791-4950-a9c3-418a0ce6d3aa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.747671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:47.748902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.749388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.749883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.751092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:47.761996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:47.766870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:47.779923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8eb1d-97bf-4471-aac4-b51bdc9d5368 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:47.782880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:47.783789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:47.784742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:47.784742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:47.784742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:47.784742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:47.787947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 335/702] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:47.794029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.823973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:47.825823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:47.826943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:47.827553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:47.841360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:47.843318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:47.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:47.865193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:47.866066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:47.866066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:47.866066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:47.866066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:47.868340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 368/703] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:47.873648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:47.976864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbdda2-0f87-483e-93ed-a63dc2fb6607 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:47.979763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.043902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.044616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.044936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.045215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.046002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:48.046312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.047687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.062620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c461f-6570-434b-b430-743d1f30967a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.072659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 336/704] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:48.078590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.118635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.130965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.131645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.131925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.132198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.133163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:48.134671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.137045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.163804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 369/705] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:48.168554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.277940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f384-59c6-4024-97e7-ba9d9bca9edb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.361214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.361424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e284fa-32d8-425c-8989-72ca79068501 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.362404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.362892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.363387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.364943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.366594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.406350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.407148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.407423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.407697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.414873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.416309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-10d6c61f-216a-4b65-92b8-7f064054385b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:48.431763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:48.433007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 370/706] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81a08-a14f-4e15-a072-8ff68a266fd3 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.438373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81a08-a14f-4e15-a072-8ff68a266fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.438979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81a08-a14f-4e15-a072-8ff68a266fd3 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.441252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 371/707] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:48.443232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac11-d971-4c1d-9249-65cdf63b9160 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.443588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac11-d971-4c1d-9249-65cdf63b9160 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.443835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eac11-d971-4c1d-9249-65cdf63b9160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.462645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e07eac11-d971-4c1d-9249-65cdf63b9160 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:48.463897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e07eac11-d971-4c1d-9249-65cdf63b9160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:48.467995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 337/708] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:16:48 2022] POST /identity/v3/users => generated 254 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:16:48.469301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.497137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.538390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.562633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 372/709] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:48.564133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6445cc-7129-4668-b7e4-edf92263c5f4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.564423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6445cc-7129-4668-b7e4-edf92263c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.564805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6445cc-7129-4668-b7e4-edf92263c5f4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.571812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 373/710] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:48.576623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.576623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.576623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.593985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:48.596072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:48.619428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e1af-313b-4e8d-bad5-3002d3f7d5c1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.661581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.662648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.662931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.663204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.664001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:48.664311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.665795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.679009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 338/711] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:48.680064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.680912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 374/712] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:48.687293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.800299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.808795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21172a-570d-4e69-934e-83030700dea4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.828256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012024-0b65-43b5-906b-ab7a5008d0e6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:48.847513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:48.853031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.854221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.854572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.855082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.856101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.857590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.874950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:48.876118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:48.876636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:48.877589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:48.878420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:48.879970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:48.879970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:48.880131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 339/713] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:48.880213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:48.880213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:48.880357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:48.881446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:48.889886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 375/714] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:48.891505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:49.057759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442672-0c9f-4890-b9a4-2c502b65f980 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:49.070340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b463839-86f4-4e62-8640-7533ae611c5a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:49.122409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:49.122635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:49.123086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:49.123281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:49.123396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:49.123567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:49.123661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:49.123835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:49.124329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:49.124547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:49.124660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:49.126053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:49.127266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:49.131986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 376/715] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:49.141495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:49.145360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:49.146478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:49.147693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 340/716] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:48 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:49.152726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:49.162991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:49.213376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:49.303202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29ca7-bd66-4cfe-b755-5e06e99a5e60 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:49.328586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490717-a661-401c-ac17-8ac1fd83a3ee None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:49.339547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:49.340125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:49.340408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:49.340714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:49.341429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:49.341736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:49.343104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:49.357273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 377/717] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:16:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:49.399006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:49.399704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:49.399988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:49.400267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:49.401051 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:49.401362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:49.402752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245af3b-cfe9-4a8a-b594-37019c06d8e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:49.408386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 341/718] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:16:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:49.414307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:49.556118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d147e-be29-4ac0-a699-6fcc9e2208f2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:49.557665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:49.596421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:49.597115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:49.597391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:49.597660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:49.598918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] RBAC: Adding query filter params (type=network) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:49.599237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:49.600960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc362-5f2c-4dbc-859d-236cb3f42030 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:49.606194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 378/719] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:16:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:50.036968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d045cd-5ca4-49fc-b93a-2453a9cd5711 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.037441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d045cd-5ca4-49fc-b93a-2453a9cd5711 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.037547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d045cd-5ca4-49fc-b93a-2453a9cd5711 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.039090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 342/720] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:50.044571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.049521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.049521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.069593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:50.070864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:50.171422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 379/721] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:50.202307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d045cd-5ca4-49fc-b93a-2453a9cd5711 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:50.304498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:50.346368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d045cd-5ca4-49fc-b93a-2453a9cd5711 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:50.392119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:50.392962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.393238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.393506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.408196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:50.416648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:50.417570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:50.418407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 343/722] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:50.424137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:50.518059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:50.524777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270680-cca3-45e0-a129-a2bd681d3b29 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:50.558538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:50.559205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.559481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.559751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.560508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:50.560811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:50.562170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:50.570550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 380/723] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:50.575980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:50.690974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423535ba-9f3d-4b07-b8ea-bb176e024673 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:50.728882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:50.734745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:50.735598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.735881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.736150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.757756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:50.759232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:50.779580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:50.780547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:50.781498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:50.781498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:50.781498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:50.781498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:50.783839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 344/724] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:50.789732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:50.923075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9f4c-c855-4d8e-a336-f26470418589 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:50.963638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:50.964228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:50.964530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:50.964812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:50.965535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:50.965843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:50.967219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:50.980417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 381/725] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:50.985706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:51.116688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7021a-309b-4b60-9b11-f01dc48cbfe6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:51.166144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:51.166946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.167232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.167511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.179476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:51.179476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2b00599c-3c41-4cb4-81a4-a48f740ae136 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:51.195214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:51.196268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:51.197630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:51.200159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 345/726] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:51.205592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:51.243997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:51.364478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aceda-62bc-4d98-bf1f-7b4cf21128d6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:51.366485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dcbc-78fd-468c-9d60-d50b7acf5439 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.366933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dcbc-78fd-468c-9d60-d50b7acf5439 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.367103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dcbc-78fd-468c-9d60-d50b7acf5439 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.368570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 346/727] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:51.373868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.374414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.374887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.393044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:51.394509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:51.416580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:51.417618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.417618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.417917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.418768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:51.419079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:51.420520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:51.448850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:51.457009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 382/728] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:16:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:51.463955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:51.508170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 347/729] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:16:51.576165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:51.605255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:51.658049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f3ce-f9b2-4a6e-926c-8fc605589312 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:51.709896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:51.711025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.711534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.712030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.733278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dfd49-1e51-4c94-aae9-7aede2b3e716 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:51.769089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:51.769877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.770160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.770438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.780991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ff4ccc92-cc09-4301-aab4-1e48d86ac4ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:51.789365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:51.790312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:51.791131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 348/730] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:51.792424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c401-aa47-49ac-b34d-de2f0bdf9102 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.792424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c401-aa47-49ac-b34d-de2f0bdf9102 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.792703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c401-aa47-49ac-b34d-de2f0bdf9102 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.793657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:51.798002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 349/731] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:51.798002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8c401-aa47-49ac-b34d-de2f0bdf9102 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:51.799656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d98e9-4f51-4298-9f2a-a75b93990992 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:51.829111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:51.884704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:51.903771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8c401-aa47-49ac-b34d-de2f0bdf9102 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:51.913670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 383/732] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:16:51.915329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.915827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.916306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.934764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:51.936381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:51.950379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:51.951061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:51.951351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:51.951617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:51.952380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:51.952717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:51.954800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:51.966812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 350/733] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:51.968109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.028761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 384/734] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:52.030159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.090473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.097080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6f84-5bd2-498e-8b14-a4b75749b302 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.132367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.133229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.133525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.133797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.144401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.145931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.146833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7489f04-a62d-48ec-b464-9dac89415882 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.156124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c0a9096a-7a84-402c-b3ce-436279ffa521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:52.163798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:52.164715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:52.165929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:52.165929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:52.165929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:52.165929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:52.169689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 351/735] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:52.170802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a598b-c696-4bf5-8266-c5c2335a58f4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.171096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a598b-c696-4bf5-8266-c5c2335a58f4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.171560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a598b-c696-4bf5-8266-c5c2335a58f4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.172871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 352/736] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:52.173416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a598b-c696-4bf5-8266-c5c2335a58f4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.189912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.190720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.191001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.191274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.204501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.205987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:52.224140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:52.225139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:52.226015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:52.226015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:52.226015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:52.226015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:52.230175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 385/737] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:52.231034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.293200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a598b-c696-4bf5-8266-c5c2335a58f4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.331520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.332372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.332745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.333034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.340953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6d98-eef3-4d0c-9b79-8bf31fc3965e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.343145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a0f0a232-859e-4c36-a59a-aa7628ac4fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:52.350890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:52.351835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:52.352679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 353/738] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:52.353373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc8da-8f20-4e46-9796-d34c5b9082fc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.353578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc8da-8f20-4e46-9796-d34c5b9082fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.353841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc8da-8f20-4e46-9796-d34c5b9082fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.365289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.370762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-580cc8da-8f20-4e46-9796-d34c5b9082fc None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:52.378458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-580cc8da-8f20-4e46-9796-d34c5b9082fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:52.379840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.380532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.380827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.381105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.381827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:52.382134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.383542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.396424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 386/739] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:52.397249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.416973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.442473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 354/740] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:52.443802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652310-04db-4233-b5ce-2d1a0dfe6a3e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.444082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652310-04db-4233-b5ce-2d1a0dfe6a3e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.444355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652310-04db-4233-b5ce-2d1a0dfe6a3e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.445630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 355/741] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:52.448627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652310-04db-4233-b5ce-2d1a0dfe6a3e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.501177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca57ef-c23d-4a03-8688-aa473d43c50e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.538298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.538989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.539271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.539546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.540286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:52.540629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.542051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.555566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 387/742] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:52.556359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.638868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.658986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2b47-5ac9-4dd9-ba0c-90fb874b4957 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.670183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652310-04db-4233-b5ce-2d1a0dfe6a3e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.693207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.694020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.694286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.694562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.701122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.702556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.702851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.703512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.703786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.704140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.705044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:52.705166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.706432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6ef5a-8783-4405-b5ca-0e6489587625 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.708750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.715056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 356/743] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:52.716223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.716520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.716798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:52.716953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:52.717788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:52.718715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 388/744] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:52.719680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.737947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:52.739712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:52.813791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 357/745] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:16:52.814678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.819897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b58b3-4110-4e8b-9cca-45d1534afe0f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.855723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.856389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.856699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.856976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.857693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.859053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.912293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc35aa-5684-4e6d-9df6-2a30e20ed800 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:52.936937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.944460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:52.945283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:52.945560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:52.945829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:52.948382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:52.952785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:52.953846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 389/746] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:16:52 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:52.954234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:52.954653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:52.970977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:52.972334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:16:52.974253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:52.977894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 358/747] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:52.978738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.089404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecab37-60e0-407d-95dc-a2fcc18d5137 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.095319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702084c9-6ae5-4cba-8721-0399b18bc982 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.130187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.130445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.130684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.130959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.138535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.139220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.139503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.139778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.141362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:53.141362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.142475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.142581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.143852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.157013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 359/748] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:53.157976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:53.164642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:53.168740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 390/749] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:53.169687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.209034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.218521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.262338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6b960-5c3f-4073-b7b3-c745f25fe87f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.273587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abfd4-75fb-405b-a578-677899f38abf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.303018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.303701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.304140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.304420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.305181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.306563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.307850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.308552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.308843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.309119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.309958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:53.310268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.311689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.329533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 391/750] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:53.330354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.391273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 360/751] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:16:53 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:16:53.392038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.456877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa823-0d3a-4302-96bb-8c06f454f57e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.460322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.503071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.504049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.504538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.504953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.505959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=aad40b6b9b26414a9d87746b77c9e560) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:53.506412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.508019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.515286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 392/752] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/role_assignments?user.id=aad40b6b9b26414a9d87746b77c9e560&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:53.516436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.528828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85463a6a-8745-4781-8637-7fbc8bb84cbc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.540310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.569952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.570807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.571184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.571716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.572384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:53.572814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.575638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.593136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 361/753] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:53.618012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.650172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb2cf-2550-4b7d-8412-c47f43a98cab None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.691303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.693050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.693526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.693977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.736513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.761120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef7ec-6561-41e8-99a9-84b7c6721154 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:53.780469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.782501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.814981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:53.815809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:53.816089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:53.816398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:53.836554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:53.838025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:53.865889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:53.867014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:53.868002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:53.868610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 362/754] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:53.874727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:53.936284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:53.992462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 393/755] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:16:53.997706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.033997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc4f-e8fa-4335-8377-57be178893ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.095966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.096673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.096958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.097236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.097815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:54.098182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:54.098482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.100036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.125009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 363/756] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:54.129616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e638cf-ce4a-4a29-b732-0a1a034d9c33 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.139108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.169851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.170578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.170855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.171125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.190585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.193203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:54.239576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:54.241500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:54.242371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:54.242371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:54.242371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:54.242371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:54.242371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 394/757] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:54.245083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.272995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:54.291647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c499-9690-4c63-a8eb-b2dc8e718ea1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.353167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.354457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.354947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.355477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.358064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8783-4166-44fb-b33d-ea68280948fa None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.373568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.375380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.386671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:54.403005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:54.404262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:54.405166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:54.405166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:54.405166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:54.405166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:54.407444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 364/758] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:54.413686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.428065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.429125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.429770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.432264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.433245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:54.433772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.435364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.461673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 395/759] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:54.466011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.563998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682adf4-dec5-45c7-9530-d19d5858caf7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.616866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.618133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.619706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.620197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.621411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:54.628980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.630514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.641026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:54.646519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 365/760] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:54.657411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.659776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f327a33-3609-466d-b59f-06262def2827 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.697078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.698166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.698732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.699164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.706718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.708633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:54.724540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:54.725447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:54.726306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:54.728916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 396/761] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:54.734086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.773573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:54.853837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d701-3b2d-4ff4-86fd-fe2427476642 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.859568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d61d8-b312-455a-be88-bf4acbf252a3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:54.904040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.904818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.905095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.905364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.913810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:54.914741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:54.915237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:54.915716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:54.916800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:54.920815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.922672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.925740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:54.928137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:54.949654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 397/762] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:54.955249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:54.957436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:54.958435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:54.959297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:54.970571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 366/763] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:54.977062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:55.092714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:55.099627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078286c3-f39e-4e2b-af67-36b28c606c2a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:55.126669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:55.138599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:55.139586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.140164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.140699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.141738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=a8e733e298f84d75adfe1ef616c4574f) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:55.142243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:55.143914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:55.150963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 398/764] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/role_assignments?user.id=a8e733e298f84d75adfe1ef616c4574f&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:55.218233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d467e-9f3b-4852-95bb-ee0a39501da9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:55.272890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:55.273550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.273827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.274097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.274883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:55.275185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:55.276662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23c98-cffb-444a-ae92-a96d79b2ccef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:55.294604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 367/765] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:55.300343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:55.434531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20a73-bcf5-40c6-b0e2-8c299d956d25 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:55.474390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:55.475781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.476436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.476962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.479386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=d125909b383a44b49e94715bde34866c, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:55.481211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:55.532903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c90ca-2289-4d61-9f07-f49b238b01ea None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.533892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c90ca-2289-4d61-9f07-f49b238b01ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.534361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c90ca-2289-4d61-9f07-f49b238b01ea None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.536388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 368/766] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:55.541140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.541418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.541686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.562385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 399/767] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:55 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:55.571859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:55.573531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:55.679288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 369/768] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:16:55.719013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:55.751039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:55.840525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49535a-2fef-4d96-af7a-c56d3939f49c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:55.884039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:55.885521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:55.886060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:55.886555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:55.887399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:55.889019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b731a974-4100-4a74-95b2-54d9e1e1794f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:55.907152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:55.908134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:55.909025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:55.912604 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 400/769] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 08:16:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:55.915653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:55.987794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.068080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c56f1-874c-410f-bb76-2084d7beb8d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.114334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f6d4-cedf-4a60-8eb0-c77d0c5c40af None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.114668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f6d4-cedf-4a60-8eb0-c77d0c5c40af None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.114895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f6d4-cedf-4a60-8eb0-c77d0c5c40af None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.116678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 401/770] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:16:56.119183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.119858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.120143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.120427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.121181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:56.121489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.122411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40745c51-1e57-463f-bb77-d8d255916f20 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.122865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.123116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40745c51-1e57-463f-bb77-d8d255916f20 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.123584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40745c51-1e57-463f-bb77-d8d255916f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.133347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 370/771] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:16:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:56.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.147157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-40745c51-1e57-463f-bb77-d8d255916f20 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:56.148605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-40745c51-1e57-463f-bb77-d8d255916f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:56.271441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 402/772] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:16:56.272897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6905d-74a9-4845-b01c-048b7a78f292 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.273186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6905d-74a9-4845-b01c-048b7a78f292 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.273465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6905d-74a9-4845-b01c-048b7a78f292 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.279176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 403/773] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:56.280461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.280775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.281055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.298749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:56.300034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:56.310690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbf99-7ae6-4754-b67d-ca146b8011ea None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.311569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.328610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.355286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.356351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.356807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.360292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.360292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:56.360292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.360652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.369026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 371/774] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:56.370003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.380183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 404/775] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:16:56.381274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.503807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b156a-4240-4141-8ce0-fffba1ca510b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.508986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21acfe4-523f-44d4-90c7-369149d8189f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.542937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.543949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.544366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.544759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.551255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.552315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.552793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.553399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.554667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] RBAC: Adding query filter params (interface=public, service_id=dbc732287d0b4129b6065e7a4692a853, region_id=RegionOne) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:56.555146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.556995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.557302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:56.565164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:56.567024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:56.568096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:56.569641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 405/776] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/endpoints?service_id=dbc732287d0b4129b6065e7a4692a853&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:56.570620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.575094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 372/777] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:56.575593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.592873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.612348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.683552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae382fe-da9d-4a5a-8c47-417cd8c65ff8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.698311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66c2cf-dbe9-4bcc-8ae2-edafedc29bfe None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.721284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.722071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.722485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.723113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.724250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.725513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.736636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 373/778] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:56.737897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.740274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.741305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.741921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.742418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] PATH_INFO: `/v3/services/network` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.743304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.744996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:56.760715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:56.761775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:16:56.762676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:56.765766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 406/779] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:56.773857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:56.932765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.938525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62fa5-05ab-4706-9d08-098b273bd1fd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:56.960694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:56.982344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:56.982735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:56.983027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:56.983305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:56.984066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:56.984373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:56.985868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:56.996537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 374/780] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:56.998468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d3d1-bce7-497e-8e73-cf0cd40d2d13 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.001470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.037777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.038566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.038922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.039270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.041626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] RBAC: Adding query filter params (name=network) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:57.041626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.043140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.048428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 407/781] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:16:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:57.054414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.157248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd89a7-dde2-4975-a560-32ac73cb6134 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.180632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903fc1-eb2c-4d06-86c8-f317b79c942c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.234681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.235456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.236468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.236594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.236878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.237142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.237535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.237803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.238598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] RBAC: Adding query filter params (type=network) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:57.238899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.240262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.243355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:57.252501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 408/782] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:57.253361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.260185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.261674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:57.289404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:57.290346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:57.291239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:57.291239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:57.291239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:57.291239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:57.291239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 375/783] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:57.301496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.337421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:57.455403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94444d0-8a78-4936-8daf-c90c381ccc3c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.499563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b515b-dae8-4cba-8d85-c77ee46fa9bf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.522657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.523329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.523608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.523882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.524710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] RBAC: Adding query filter params (interface=public, service_id=f4203501193f41b69be8c777a693c8dc, region_id=RegionOne) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:57.525019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.526388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.541309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 409/784] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/endpoints?service_id=f4203501193f41b69be8c777a693c8dc&interface=public®ion_id=RegionOne => generated 194 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:57.546636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.568428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.569133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.569413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.569683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.570416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:57.570717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.572100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.585715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 376/785] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:57.593596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.652926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:57.697905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:57.704272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10521-9513-4f2c-bea9-14afe680dcb1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.725293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f88a-e3e4-48fc-a44a-15da6e112cc9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:57.743743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.744861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.745349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.745800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.746764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.748434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e004f-9980-4fba-a357-e07301c4c6d3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.761270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 410/786] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:57.762829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44703-014c-4904-b178-2082b2865199 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.763119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44703-014c-4904-b178-2082b2865199 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.763403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44703-014c-4904-b178-2082b2865199 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.765769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 411/787] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:57.772974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71daa-0319-4900-a999-661351295688 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.773293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71daa-0319-4900-a999-661351295688 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.773539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71daa-0319-4900-a999-661351295688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.778380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:57.779210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:57.779495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:57.779832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:57.798934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:57.800428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:57.809440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-94b71daa-0319-4900-a999-661351295688 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:57.810674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-94b71daa-0319-4900-a999-661351295688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:57.827391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:57.828429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:57.829411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 377/788] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:57.835122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:57.956572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 412/789] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:16:57.992237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71daa-0319-4900-a999-661351295688 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.003781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c583f8-ce64-488e-a776-efe22ff0dcb2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.042503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.043562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.043845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.044123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.045060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:58.045382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.046808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83e4f0-f84d-4fbc-b2bf-96f623eeed9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.049009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.059408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.067413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 378/790] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:58.069053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d5cb-c7c9-4c4c-85e6-6679b3d4499e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.069677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d5cb-c7c9-4c4c-85e6-6679b3d4499e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.070134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d5cb-c7c9-4c4c-85e6-6679b3d4499e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.072707 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 379/791] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:58.073610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d5cb-c7c9-4c4c-85e6-6679b3d4499e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.106180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71daa-0319-4900-a999-661351295688 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.151150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.152718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.153081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.153718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.169513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-7e4224b8-5402-4f21-b0d3-2e64df5192c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:58.179610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:58.180600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:16:58.181423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:58.182074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 413/792] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:16:58.183024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.183667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.184040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.205345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:58.207808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:58.210654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d5cb-c7c9-4c4c-85e6-6679b3d4499e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.258443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.259271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.259659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.260256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.271771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.273426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.290353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 414/793] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:16:58.291278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:58.292516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:58.294243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:58.296352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:58.296352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:58.296352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:58.296352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:58.296352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 380/794] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:58.300366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.344070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.349506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.401207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c57fc-c205-497c-8b57-335e964be0b2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.405785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b28cdc-c28e-4f79-8528-4b3741b49cb9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.440232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.441693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.442028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.442311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.442523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.443070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:58.443324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.443487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.443778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.444122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.444798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.445075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:58.445447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.446868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.458769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 415/795] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:58.459666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.460166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 381/796] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:16:58.465364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.565277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613524f-59d7-4c96-95c6-eb7177f44dc6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.568183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.570548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a09d8-2e2e-447c-ba96-6dec66f49437 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.581617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.601192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.602001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.602264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.602533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.609230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.610540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.610997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.611526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.613862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.615504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.624482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:16:58.633063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:58.634171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:16:58.635410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:58.636026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:58.636858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:58.637755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:58.637755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:58.637755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:58.637755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:58.639538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 416/797] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:58.640503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.640732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 382/798] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:58.641634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.746295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0e4d-493d-4182-a622-70721e2b4aa0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.749538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaae04-fba5-4549-b627-f65439292731 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.781860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.782526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.782807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.783283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.783797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:58.784102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.786132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.789751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.790825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.791330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.791819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.799225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.801279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.803095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 383/799] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:58.803804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:16:58.819998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:58.821137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:16:58.822042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:58.823453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.825612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 417/800] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:58.826684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.865506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:58.924198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2589a-03e0-47c7-bfea-b131c20cf4ba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.943852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317b92-4e9b-4d94-a457-1a3188b8c929 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:58.959812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.960501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.960790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.961063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.961864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:58.962114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.963494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:58.973099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 384/801] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:58.974031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:58.986371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:58.987544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:58.988133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:58.988655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:58.996925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:58.998601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:59.015324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:59.016290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:16:59.017241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.020558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 418/802] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:59.021718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.062250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.084837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18d62-76f3-47ee-a977-e851035c215e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.120833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.121521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.121801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.122077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.122872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:59.123232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.124734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.128307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.140361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891dff9-4d1f-46a7-8e45-e23d0e8170e3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.143812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 385/803] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:59.143918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.178859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.180050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.180570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.181080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.193310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.195228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:59.216366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:59.217346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:59.218245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:59.218245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:59.218245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:59.218245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.220730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 419/804] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:59.221859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.251699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213db7-63d5-4b71-9667-d45b8894d3f9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.287249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.287925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.288208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.288498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.289332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:59.289638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.291062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.298825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.310601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 386/805] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:59.311391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.336998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761397-e307-4e29-929d-14c23388e688 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.375499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.376387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.376692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.376972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/aad40b6b9b26414a9d87746b77c9e560/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.379704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=aad40b6b9b26414a9d87746b77c9e560, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.381166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c42aca-2125-4bc4-b345-c2a30012f927 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.412972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dace9-ca9b-431f-b70e-23d7a90d3f4e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.447243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.447885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.448163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.448434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.449174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:16:59.449478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.450836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33637d7-2941-499c-9235-b4cd8cba8eb7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.453859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 420/806] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:16:59 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/aad40b6b9b26414a9d87746b77c9e560/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:16:59.455336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69902d8-7b23-46ce-8899-41f2e3abbb9d None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.455753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69902d8-7b23-46ce-8899-41f2e3abbb9d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.456208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69902d8-7b23-46ce-8899-41f2e3abbb9d None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.458752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 421/807] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:16:59.459838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69902d8-7b23-46ce-8899-41f2e3abbb9d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.466932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.474239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 387/808] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:16:59.475776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.476063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.476338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.500277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:16:59.502335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:16:59.580083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.591132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69902d8-7b23-46ce-8899-41f2e3abbb9d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.608916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 388/809] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:16:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:16:59.610068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.643133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.643949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.644313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.644752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.658958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.660466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:16:59.680198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:59.681401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:59.682445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:16:59.682445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:16:59.682445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:16:59.682445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.682445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 422/810] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:59.682782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.752430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902d3f-ca87-49be-97cb-8e78a059a9ad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.758292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.800036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.802169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.802471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.802751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.813460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.815740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.817060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3e40-800f-46bc-b589-1cc7a65b804f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:16:59.836057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:59.837280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:16:59.838401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:16:59.838926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 389/811] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:59.839684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.864323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:16:59.866149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:16:59.866637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:16:59.867111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:16:59.867964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:16:59.870388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:16:59.888053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:16:59.889255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:16:59.890093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 423/812] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:16:59.890981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:16:59.911794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:16:59.983564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2c23-57f3-413a-b092-909755c21dd1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.021623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.022293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.022582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.022857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.023590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:00.023897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.025306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.037342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e828d-6a2a-47c1-96d0-40024c375086 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.042993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 390/813] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:00.042993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.091869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.091869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.091869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.091869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.092340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.092787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:00.093374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.095605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.120441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 424/814] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:16:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:00.121593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.180289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e6dc-941c-4725-9d22-c73fd7a4a4b0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.187931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.214756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.215471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.215749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.216016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.216761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:00.217066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.218418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.228599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 391/815] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:00.228599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.237520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453058-aa2b-4832-ac99-771e916b2fa3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.277203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.278005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.278290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.278566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.285944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.287385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-682febbf-b6ba-4fe5-9744-9e31e9d49b78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:00.301411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:00.302292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:00.303186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 425/816] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:00.304210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735bea-0c97-4544-836a-508acc1a2526 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.304210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735bea-0c97-4544-836a-508acc1a2526 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.304454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735bea-0c97-4544-836a-508acc1a2526 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.308608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 426/817] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:00.308608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735bea-0c97-4544-836a-508acc1a2526 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.344128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebecbe9-2c86-4381-987f-7280b8a51887 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.346904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.381101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.381670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.381953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.382228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.415503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735bea-0c97-4544-836a-508acc1a2526 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.429872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.456029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.457359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.457688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.457971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.458683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:00.458992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.459217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.460372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.460839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4593f88-a477-4426-b720-cb9f48316046 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.470374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 427/818] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:00.470374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.567039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 392/819] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:00.568403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98be8-110e-4481-858f-1f393e835997 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.568726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98be8-110e-4481-858f-1f393e835997 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.569006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98be8-110e-4481-858f-1f393e835997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.584149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.587225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180695-1b2f-41c7-9a3f-564adbbaf1a5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.589191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-06a98be8-110e-4481-858f-1f393e835997 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:00.590371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-06a98be8-110e-4481-858f-1f393e835997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:00.624455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.625152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.625437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.625711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.626505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:00.626813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.628238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.641098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 428/820] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:00.641864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.665844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.671284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 393/821] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:00.672276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a98be8-110e-4481-858f-1f393e835997 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.770811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6bc76-cf0d-4b84-bd90-e92ac745cc12 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.798542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a98be8-110e-4481-858f-1f393e835997 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:00.810795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.811643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.812122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.812719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.813719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.815436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.836117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:00.839197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:00.839197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:00.839197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:00.847723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:00.849323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:00.869573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:00.870580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:00.871512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:00.871512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:00.871512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:00.871512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:00.871512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 394/822] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:00.872146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.918935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 429/823] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:00.920243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:00.934896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:00.963153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.002569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79f32-9578-497a-a3b4-5cebe41c7c63 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.078631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b22b3-68d7-43eb-9e65-212b75fe52a7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.083911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cdece-9607-406e-8845-31917148f17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.085128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdece-9607-406e-8845-31917148f17e None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.085558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdece-9607-406e-8845-31917148f17e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.085987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdece-9607-406e-8845-31917148f17e None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/a8e733e298f84d75adfe1ef616c4574f/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.103402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cdece-9607-406e-8845-31917148f17e None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=a8e733e298f84d75adfe1ef616c4574f, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.105155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cdece-9607-406e-8845-31917148f17e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.123223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.123749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.124096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.125013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] PATH_INFO: `/v3/services/network` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.125190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.126790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:01.192323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:01.193623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:01.194627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 430/824] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:00 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:01.195580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.245556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 395/825] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:17:00 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/a8e733e298f84d75adfe1ef616c4574f/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:17:01.246618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cdece-9607-406e-8845-31917148f17e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.260679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.283180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc3e8-2d29-4f5b-9e04-d79dbfdc9781 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.321162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.321848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.322132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.322411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.323149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:01.323457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.324868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.338846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 431/826] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:01.344206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.409292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.417737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cdece-9607-406e-8845-31917148f17e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.465601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.466746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.467331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.467803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.468858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:01.469359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.471037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.478153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 396/827] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:01.487461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.522470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c58d7-f786-4c6d-9ba7-454897c4bb66 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.563152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.564027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.564315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.564621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.570238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.579008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.580468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:01.602478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:01.603408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:01.604724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 432/828] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:01.613657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.653485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca6f69-f402-4d7a-99e1-383baf9300b9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.700764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.702252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.702731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.703230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.704142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:01.704687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.706273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.720739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 397/829] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:01.726175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.764798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42cdc3-6817-4b93-a815-3c84713f0051 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.778635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.810758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.811426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.816509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.816509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.816509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:01.816509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.816509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2479-3cd3-4213-b727-05eb906bd813 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:01.833237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 433/830] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:01.834932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08662c2-9117-47e9-938e-9b05a2a6da8d None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.835216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08662c2-9117-47e9-938e-9b05a2a6da8d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.835493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08662c2-9117-47e9-938e-9b05a2a6da8d None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.837209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 434/831] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:01.839612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08662c2-9117-47e9-938e-9b05a2a6da8d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:01.881081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b8459-87b5-4bc6-a78d-4aaa3ddd46b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:01.925016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:01.930621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:01.931619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:01.931963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:01.932311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:01.933314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:01.935347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:02.021595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08662c2-9117-47e9-938e-9b05a2a6da8d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:02.021595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:02.021595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.021595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.022010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.022010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:02.022010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:02.022010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a19e0-d9a8-4d98-9cf5-f97064558d0c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:02.028607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 435/832] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:01 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:02.028607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.028607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.028607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.045067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:02.046372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:02.104095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 398/833] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:02.143228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 436/834] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:02.187748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:02.301568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:02.320113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d6f4-c352-43f5-b9ee-d3e67799b0dd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:02.355937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:02.356766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.357053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.357332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:02.380320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:02.381326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:02.382141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 399/835] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:02.388043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:02.447398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:02.514667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158056ca-8dee-46f3-86fb-98566ddd5c8b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:02.552354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:02.553061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.553250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.553525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.554270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:02.554574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:02.555933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:02.564891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 437/836] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:02.571012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:02.678820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f00ff5-5b73-438a-b9ae-e395bfde8c9f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:02.714379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:02.715925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.716396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.716866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.728233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:02.729926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:02.731806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:02.748834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:02.757082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:02.758028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:02.758028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:02.758028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:02.758028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:02.758028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 400/837] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:02.759381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:02.864609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16deab-c225-4734-b774-ae0fe90a36c7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:02.881329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:02.901514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:02.902179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:02.902458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:02.902730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:02.903444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:02.903747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:02.905177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:02.919014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 438/838] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:02.924659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.031564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddb64-cb8f-4a7b-bdd9-40bd0524541a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.068280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.069142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.069424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.069697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.077753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:03.079194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:03.094305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:03.095332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:03.096288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 401/839] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:03.104058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.209558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfaba9-b65a-4797-a72d-a8e41e82276b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.244607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.245283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.245562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.245835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.246659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:03.246964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:03.248370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e678c-53b3-4565-8473-b59838769aa1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:03.266407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 439/840] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:03.272528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.330081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:03.376327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7dd2-8c25-4c70-bc30-950a362c8352 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.412454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.413575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.414064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.414543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.496561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:03.498020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:03.538552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c7474-27f4-4796-9197-734ead9776eb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.539187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c7474-27f4-4796-9197-734ead9776eb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.539670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c7474-27f4-4796-9197-734ead9776eb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.541516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 440/841] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:03.546951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f3a91-6f5f-468d-81e1-feaeac240915 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.547517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f3a91-6f5f-468d-81e1-feaeac240915 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.548008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f3a91-6f5f-468d-81e1-feaeac240915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.564838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:03.568611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7c3f3a91-6f5f-468d-81e1-feaeac240915 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:03.571064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7c3f3a91-6f5f-468d-81e1-feaeac240915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:03.619532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 402/842] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:03.619767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:03.621162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.672542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 441/843] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:03.672542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea29b1-2d92-4e99-98ce-3570cc47922b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.672542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea29b1-2d92-4e99-98ce-3570cc47922b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.672542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea29b1-2d92-4e99-98ce-3570cc47922b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.675217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 442/844] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:03.677497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.677784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.678061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.694816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:03.695997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:03.740009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3ea-b222-4b11-a59b-4602a93380b0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.766350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 443/845] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:03.767175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.785369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.786840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.787306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.787760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.799316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:03.801164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:03.819133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:03.820211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:03.821171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:03.821171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:03.821171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:03.821171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:03.821171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 403/846] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:03.821597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.832064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:03.860776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:03.877780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac46706-244e-4509-89ed-4f1c5ca593e0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.921471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.922368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.922653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.922929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.923582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:03.925025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:03.931799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd32e-63af-43d2-b730-2f82c2503909 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:03.937099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:03.938092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:03.941971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 444/847] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:03.942792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:03.972979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:03.973773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:03.974052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:03.974324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:03.985805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:03.994661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:03.995633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:03.996452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 404/848] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:03.997766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.049112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f85d3-79b6-4a30-bef5-936664c759da None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.068362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.087281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.087996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.088279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.088588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.089370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.089682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.091056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.103797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 445/849] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.104711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.111970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7be50-d672-4721-8768-5ca2f1ccab74 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.117569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.150728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.151395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.151679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.151954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.152773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.152997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.154360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.164061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 405/850] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.164061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.213681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8e78-f9df-486a-8aa6-c8bca531d57a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.248880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.249548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.249829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.250107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.250850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.251154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.252541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.265128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 446/851] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.265128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.278013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf1b2-022f-4984-81de-2367a3110796 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.309557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.315859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.316885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.320536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.320536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.324179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.325659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.336970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:04.340938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:04.341988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:04.343083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:04.351471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 406/852] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:04.352554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.369204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b364d4-8e11-46e0-8204-af05e9034761 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.407728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.408431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.408755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.409014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.409785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.410090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.411639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.424540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 447/853] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.424540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.484162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb51be-e9f5-444c-accd-6ae0f25ac7c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.524923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.525728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.526009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.526312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.538198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a7ed-07a6-4e1c-b0fc-03cede627540 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.538415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.539758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ba0ce0cb-a5d3-446e-af01-5f08c6efa01e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:04.559700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:04.560814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:04.561900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:04.561900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:04.561900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:04.561900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:04.568008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 407/854] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:04.569413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448c17-a0ed-461e-8e6f-1c0ce9f95e0c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.569697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448c17-a0ed-461e-8e6f-1c0ce9f95e0c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.569968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448c17-a0ed-461e-8e6f-1c0ce9f95e0c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.571345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 408/855] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:04.572073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448c17-a0ed-461e-8e6f-1c0ce9f95e0c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.585830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.586538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.586819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.587097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.587895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.588203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.589679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805b9d9-4f60-403d-9641-ace9f4625311 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.592935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.604904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 448/856] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.606707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.606876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.607259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.625223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:04.625741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.626661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:04.685560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448c17-a0ed-461e-8e6f-1c0ce9f95e0c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.702076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 449/857] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:04.703178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.728293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.729261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.729751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.730102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.730955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.731265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.732716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.744733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 409/858] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.745434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.847105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb21206-504e-4cae-a1a7-f7760d0072b8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.851878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cc20-1ed3-4f4c-9095-afe2ebf1f64e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:04.853647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.880806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:04.892194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.892588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:04.893284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.893452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:04.893595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.894427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.895245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:04.895433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.895572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:04.896510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.896668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=aad40b6b9b26414a9d87746b77c9e560) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:04.897200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:04.899358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:04.911403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 450/859] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/role_assignments?user.id=aad40b6b9b26414a9d87746b77c9e560&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:04.920529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:04.920729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:04.921776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:04.922797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 410/860] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:04.929507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:05.061996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd92f0-4933-401f-995b-e91f5d4df0ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.065209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce35e5-9077-47f6-81a5-7a8fcec9f6ff None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.101373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.101970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.102264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.102539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.103253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:05.103608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.105167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.105271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.105897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.106179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.106448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.115630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 411/861] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:05.116570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:05.117739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.119367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:05.137086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:05.138167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:05.140268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:05.143471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 451/862] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:17:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:05.145957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:05.157927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:05.225594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:05.255474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2738-2e56-4f0b-85e4-30f33d0cb0d1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.296800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.297549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440f670-ee11-4b22-baa0-b9e2e251abb1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.298092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.298576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.299321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.301252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:05.301567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.302970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.314037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 412/863] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:05.341861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.342588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.342925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.343201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.344112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:05.344421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.345922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.368455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 452/864] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:17:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:05.374427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:05.484012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:05.496102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d573c-b5ff-4d59-bbb9-e930881e904f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.533013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.533679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.533963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.534382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.607031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.608518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.706681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:05.714151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 413/865] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:05.719652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:05.830134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ad26e-17a3-4e6b-9d26-efae20657106 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:05.841337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:05.869805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:05.870949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:05.871459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:05.871927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:05.883858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:05.885839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:05.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:05.906816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:05.907663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:05.907663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:05.907663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:05.907663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:05.913132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 453/866] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:05.917588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:06.020101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fe7-ff27-411d-877e-49eb0593d8ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:06.061783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:06.062448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.062724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.062994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.063715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:06.064015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:06.065405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:06.078676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 414/867] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:06.085375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:06.195605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652b52-979e-472a-b58f-d760e9176aff None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:06.232106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:06.232937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.233216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.233489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.241811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:06.243260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:06.258426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:06.259340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:06.260544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 454/868] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:06.265736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:06.325976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:06.372743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66a2d-e8cd-47a1-b594-48493ad2976b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:06.408456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:06.409164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.410136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.410415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.411305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:06.411614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:06.413137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f469bb-d50d-45f1-ab6c-6d213c09ba34 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:06.426282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 415/869] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:06.431817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:06.455508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:06.546683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0652-2536-49d5-9322-bb32cd33ce95 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:06.586738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:06.587398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.587677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.587947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.588807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=a8e733e298f84d75adfe1ef616c4574f) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:06.589169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:06.590717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84813e-22a5-48b8-aabe-469b751c1097 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:06.596766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545acf-56f1-49c2-976f-e604bfdf5147 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.597094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545acf-56f1-49c2-976f-e604bfdf5147 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.597380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545acf-56f1-49c2-976f-e604bfdf5147 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.598039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 455/870] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:06 2022] GET /identity/v3/role_assignments?user.id=a8e733e298f84d75adfe1ef616c4574f&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:06.599092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 416/871] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:06.604579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f26a-d5d8-47b8-87be-cc152cc0111b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.604871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f26a-d5d8-47b8-87be-cc152cc0111b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.605151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f26a-d5d8-47b8-87be-cc152cc0111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.625565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-23c2f26a-d5d8-47b8-87be-cc152cc0111b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:06.626886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-23c2f26a-d5d8-47b8-87be-cc152cc0111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:06.705023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 456/872] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:06.728428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545acf-56f1-49c2-976f-e604bfdf5147 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:06.839759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545acf-56f1-49c2-976f-e604bfdf5147 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:06.854511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:06.876667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:06.877341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:06.877621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:06.877899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:06.879504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:06.880969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044b7d-bf3d-466b-a61f-f8c0efcde94d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:06.951683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 417/873] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:06 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:07.306446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fcc0a-fc14-465f-a0a9-33f764b7ab23 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.307255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fcc0a-fc14-465f-a0a9-33f764b7ab23 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.307255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fcc0a-fc14-465f-a0a9-33f764b7ab23 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.308627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 457/874] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:07.313821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca527-89b7-4af6-a084-bf48093a9951 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.314110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca527-89b7-4af6-a084-bf48093a9951 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.314424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca527-89b7-4af6-a084-bf48093a9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.332103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-da7ca527-89b7-4af6-a084-bf48093a9951 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:07.333381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da7ca527-89b7-4af6-a084-bf48093a9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:07.416603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 418/875] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:07.434449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fcc0a-fc14-465f-a0a9-33f764b7ab23 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:07.460854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:07.547775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fcc0a-fc14-465f-a0a9-33f764b7ab23 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:07.579064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ecf-8e76-457c-bf7c-bce77160c7e2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.579064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ecf-8e76-457c-bf7c-bce77160c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.579064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ecf-8e76-457c-bf7c-bce77160c7e2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.580403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 419/876] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:07.584635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:07.584635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.584635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.584868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.585442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:07.586864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.587093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:07.587549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.588050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:07.599823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:07.601008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:07.601831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 458/877] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:07.607171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:07.609558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:07.611099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:07.688744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 420/878] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:07.703651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:07.713115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:07.728823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559065e-56fa-4d7e-a3e5-12131c329885 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:07.750711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:07.765569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:07.766247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.766530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.766810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.767666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:07.767861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:07.769481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:07.774753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 459/879] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:07.780529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:07.835644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094e733-5112-400f-a308-9adf9b1ca3ac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:07.879388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:07.880374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.880789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.881165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.882132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:07.883601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d0c6-e605-4a5a-87f6-f6b59fb727fb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:07.908451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e7f-92bc-46e7-92ce-33d986c5426d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:07.946119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:07.946777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:07.947056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:07.947329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:07.948030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:07.948332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:07.949723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2c7f3-c50e-4839-9919-829dbd545295 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:07.954846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 460/880] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:07.985460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 421/881] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:07 2022] POST /identity/v3/services => generated 269 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:17:08.921467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c633f-e3eb-4598-ba6e-f36396881a0f None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:08.921892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c633f-e3eb-4598-ba6e-f36396881a0f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:08.921995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c633f-e3eb-4598-ba6e-f36396881a0f None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:08.923585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 461/882] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:08.929415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd88e-aabe-4bba-8c86-450457d3a20e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:08.929700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd88e-aabe-4bba-8c86-450457d3a20e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:08.929973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd88e-aabe-4bba-8c86-450457d3a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:08.951994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-415fd88e-aabe-4bba-8c86-450457d3a20e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:08.954119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-415fd88e-aabe-4bba-8c86-450457d3a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:09.031288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 422/883] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:09.055148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c633f-e3eb-4598-ba6e-f36396881a0f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.066019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.177719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c12243-3703-418b-9e10-ffd1e61c560e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.177928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c12243-3703-418b-9e10-ffd1e61c560e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.178154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c12243-3703-418b-9e10-ffd1e61c560e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.179790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 423/884] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:09.185048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c633f-e3eb-4598-ba6e-f36396881a0f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.185199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.185486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.185763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.202882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:09.204381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:09.216664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.221334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.222559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.222841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.223113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.237271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:09.248588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:09.249515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:09.250339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 462/885] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:09.256104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.289262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 424/886] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:09.311215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.337776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.376086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec71-fc5a-4a3c-bcef-9751085eff28 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.413832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.414506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.414826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.415110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.415983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:09.416389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.417817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.426643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 463/887] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:09.432293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.437941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc482a9-392e-40a2-b833-11ce2c3e2efb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.484411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.485497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.485779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.486436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.487101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.488768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:09.511610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:09.512763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:09.513599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:09.516706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 425/888] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:09.520708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.533551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.549549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0e38-12d0-403c-8745-c255e3d5b6d9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.579563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.588884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.590279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.590805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.591223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.602814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.604450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:09.624972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:09.626078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:09.627194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:09.627194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:09.627194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:09.627194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:09.627828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690386e8-f2f8-4621-b40c-fde11255c13c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.634358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 464/889] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:09.635630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.679093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.679826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.680107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.680378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.681139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:09.681620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.682837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.692575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 426/890] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:09.694245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.754867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0bf6-ad42-4da6-af3e-e6763c8296b9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.786795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.803509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.805025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.805590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.806044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.807414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:09.807906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.813687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.813971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846cb3-6c81-4248-b6ba-61ea490c9e46 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.830955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 465/891] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:09.832369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.863179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.864286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.865231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.865700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:09.866871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:09.867529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:09.869826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:09.881461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 427/892] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:09.883310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:09.891710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:09.955136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70ec69-e356-45d6-950c-1f354f42f00a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:09.991276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:09.992237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:09.992797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:09.993185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.002969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.004948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.015795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7899fbb-c210-4c7e-bb81-60a80ff2163f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:10.026965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:10.028133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:10.029319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:10.037358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 466/893] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:10.041813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.060787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.061656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.062023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.062337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.063300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] RBAC: Adding query filter params (interface=public, service_id=65314bceb2df4846961154fe51d537c5, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:10.063867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.065566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.078908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 428/894] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:17:09 2022] GET /identity/v3/endpoints?service_id=65314bceb2df4846961154fe51d537c5&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:10.079903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.083384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.176296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.180208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cede4-7686-4a8b-b0db-f22f2715f428 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.203716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a909e-8ec4-4893-a023-4bfb48a9c44a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.216833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.217441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.217723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.217996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.218932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:10.219261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.220714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed81e64-b795-4368-9623-ef872caf2463 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.241528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 467/895] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:10.242877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2ba6f-5589-4bf6-aca4-49218a2de3a8 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.243170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2ba6f-5589-4bf6-aca4-49218a2de3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.243447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2ba6f-5589-4bf6-aca4-49218a2de3a8 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.248726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 468/896] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:10.248726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2ba6f-5589-4bf6-aca4-49218a2de3a8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.255337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.256079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.256367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.256679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.257394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.258817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57c79b-1c05-4de7-9c3f-7d7ba09a83e4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.265698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 429/897] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:17:10.267027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb348e3-7862-4fc9-bfd7-a0174f7abf44 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.267317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb348e3-7862-4fc9-bfd7-a0174f7abf44 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.267596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb348e3-7862-4fc9-bfd7-a0174f7abf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.286546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ffb348e3-7862-4fc9-bfd7-a0174f7abf44 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:10.287803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ffb348e3-7862-4fc9-bfd7-a0174f7abf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:10.370331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.379109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 430/898] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:10.380756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6b82-1df6-4b01-a580-215c201354df None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.385073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6b82-1df6-4b01-a580-215c201354df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.385073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6b82-1df6-4b01-a580-215c201354df None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.385073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 431/899] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:10.389175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.389714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.390220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.403290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2ba6f-5589-4bf6-aca4-49218a2de3a8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.409776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:10.411801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:10.443650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.444306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.444824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.444947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.474299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.486746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 432/900] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:10.488570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.528364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.529867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.594666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22caa1c-d71f-4c15-9132-11d60d8bb7b2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.621777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.632905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3862-a330-4447-b418-b55479a88004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.638355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 469/901] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:10.638490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3862-a330-4447-b418-b55479a88004 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.638490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3862-a330-4447-b418-b55479a88004 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.638490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3862-a330-4447-b418-b55479a88004 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.638734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.638825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3862-a330-4447-b418-b55479a88004 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.638825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3862-a330-4447-b418-b55479a88004 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.697544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:10.715739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 433/902] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:10 2022] POST /identity/v3/services => generated 241 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:10.716612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3862-a330-4447-b418-b55479a88004 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.759870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486983-9dbc-4991-9351-7fbe57759f25 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.814873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.816371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.816835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.817300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.818413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.820220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:10.835944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:10.836993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:10.837818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:10.841671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3862-a330-4447-b418-b55479a88004 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.842391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 470/903] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:10.843708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.885391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:10.886209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:10.886493 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:10.886771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:10.907349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:10.907349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:10.929478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:10.930718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:10.931855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:10.931855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:10.931855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:10.931855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:10.931855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 434/904] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:10.936348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:10.983078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1ab6-cea6-4a60-9c62-87fc1d5dddcd None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:10.991310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.007028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.028709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.030063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.030358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.030641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.031361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.031677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.033107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.040176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 471/905] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:11.045851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.069698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75440150-8f72-4e6d-ba17-871f93f730c9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.107368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.108595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.109031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.109485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.110410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.110916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.113278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.126895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 435/906] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:11.134112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.153276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb1678-4922-45ee-8b8d-2d82df6bd0df None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.189713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.190692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.191145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.191574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.192545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.192863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.194346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.200548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 472/907] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:11.210056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.264586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.269317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2598-505f-44e2-8e02-7421dcbcf6a6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.278098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.318457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.318457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.318457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.318457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.328312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.329888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.343288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86f35-ebde-4c1d-8764-041723db7937 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:11.348862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:11.349747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:11.350625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 436/908] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:11.357330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.389381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.390412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.390912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.391393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.392371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] RBAC: Adding query filter params (interface=public, service_id=75de64f5f1604a39994e7682d8cfad96, region_id=RegionOne) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.392913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.395174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.401044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 473/909] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/endpoints?service_id=75de64f5f1604a39994e7682d8cfad96&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:11.409613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.475444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864beb2-cd51-43ac-a31f-1c3b11ce2256 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.515938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.516777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.517378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.517664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.519427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.519589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.521553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.524084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5017f-16d3-4dc4-8390-2197dacaa964 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.538025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 437/910] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:11.538604 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.543929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:11.567479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.568221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.568582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.568790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:11.568892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.570191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.571695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eefcf-7a4c-47f8-97ee-84453807b9f8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.581258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 474/911] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:17:11.670728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e199-9e90-42bd-9430-920ab9e90386 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:11.710033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:11.711097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:11.711585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:11.712096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:11.713197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] RBAC: Adding query filter params (role.id=5fbb3b8738ac4eae945a34c75d2cdc86, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=a8e733e298f84d75adfe1ef616c4574f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:11.713743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:11.715549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbae1b1-cbe6-4f82-96ea-4536b22cfcc8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:11.723214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 438/912] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:11 2022] GET /identity/v3/role_assignments?user.id=a8e733e298f84d75adfe1ef616c4574f&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=5fbb3b8738ac4eae945a34c75d2cdc86 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:12.539212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb45-87e0-4890-92f6-f007bc56a1a5 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.539733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb45-87e0-4890-92f6-f007bc56a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.539812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb45-87e0-4890-92f6-f007bc56a1a5 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.541500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 475/913] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:12.546830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.547217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.564259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:12.565512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:12.642488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 439/914] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:12.666278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15fb45-87e0-4890-92f6-f007bc56a1a5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:12.773735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15fb45-87e0-4890-92f6-f007bc56a1a5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:12.810368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:12.811514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.812022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.812534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.813424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:12.815532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-43708b07-0174-437f-aef5-1bb4dcd54971 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:12.828291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:12.829317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:17:12.830154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:12.833808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 476/915] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:12.839641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:12.858082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:12.955235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabda6-73ff-4e95-8eff-48dcfe29f683 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:12.982930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ef08-e419-4b30-ae9f-9e7aafcf960b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.983241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ef08-e419-4b30-ae9f-9e7aafcf960b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.983493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ef08-e419-4b30-ae9f-9e7aafcf960b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.985908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 477/916] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:12.993026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.993441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.993840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.996004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:12.997176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:12.997448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:12.997725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:12.998536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:12.998844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.000218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.006977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 440/917] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:13.019553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.021151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:13.022866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:13.062997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.106015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.114909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 478/918] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:13.133758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be4ab-0edc-4b1e-99b2-012ba306b918 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.138150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.168749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.169416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.169699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.169973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.170676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:13.170980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.172348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.182858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 441/919] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:13.184140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.242752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475032-08ed-4539-a5b8-b2f74b1f2e4f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.280481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.281399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.281778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.282066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.282825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.284238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.285693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d204-28e5-4226-9754-cb4d32a2f1c1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:13.297179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:13.298205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:13.299043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 479/920] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:13.307991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.325761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.326343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.326620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.326887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.327703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.329097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.337335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.350536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.419330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875642-a155-4f23-90a9-9444a9ee98f5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.437043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 442/921] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:13.474951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.475697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.475984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.476259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.477012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:13.477321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.478738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.484841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 480/922] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:13.491475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.606396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca7764-e4e1-4564-9cf7-ead25a492803 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.643002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.643697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.644081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.644362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.645110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:13.645416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.646791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f412b-3756-4b91-b0b0-dfcdb11c1e94 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.652309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 443/923] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:13.658240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.763001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.765666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec18c-1f41-431b-9761-81b5a6819866 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.766282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec18c-1f41-431b-9761-81b5a6819866 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.766761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec18c-1f41-431b-9761-81b5a6819866 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.769209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 444/924] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:13.773684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4322f93-7501-4e65-978f-f62b6074ecef None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.778923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.778923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.778923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.793911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:13.795433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:13.810039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.810713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.810993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.811267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.812065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] RBAC: Adding query filter params (interface=public, service_id=7f5eb3f0fae4477d9b281bb3a36d55d4, region_id=RegionOne) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:13.812377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.813993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:13.819772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 481/925] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/endpoints?service_id=7f5eb3f0fae4477d9b281bb3a36d55d4&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:13.825297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.870849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:13.892537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 445/926] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:13.914996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:13.954778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4528e7-e5a8-4a37-a254-8f2996cbdbc8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:13.992681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:13.993361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:13.993648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:13.993928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:13.994892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:13.996064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4146-3c9d-4afe-b8b5-d1c96e16e252 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.004450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 482/927] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:17:14.005757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a90b-0fca-422e-933c-732d7748874c None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.006119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a90b-0fca-422e-933c-732d7748874c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.006392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a90b-0fca-422e-933c-732d7748874c None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.007765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 483/928] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:14.014001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.014329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.014565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.033497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:14.035307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:14.052938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8ae2-7f29-473a-8ef0-3bffb70367bb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.053610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.097108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.098232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.098619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.099057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.099838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.101661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:14.116460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:14.117722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:17:14.118743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:14.124958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 446/929] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 08:17:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:14.126505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.134977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 484/930] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:14.158571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.194694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.247725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860955ad-d24b-4e91-bac4-69a3804abb2b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.282602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60030b3-1ef2-4d13-802b-640857d64fc8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.288775 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.289458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.289741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.290016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.290737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:14.291041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.292422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.300088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 447/931] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:14.306244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.331794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.333182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.335068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.336237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.348746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:14.357961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:14.358940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:14.359777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:14.363193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 485/932] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:14.371687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.389450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.436077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311a4-a6e4-4ff5-b0a3-686e84594c78 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.454667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.473223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.474234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.474729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.475207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.476125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:14.476676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.478242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.483732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 448/933] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:14.490204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.508748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e5c8-8dbd-48f2-9ceb-af6fe45681a1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.547953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143609-dbea-447e-aba8-87564e04383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.549257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143609-dbea-447e-aba8-87564e04383e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.549797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143609-dbea-447e-aba8-87564e04383e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.550379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143609-dbea-447e-aba8-87564e04383e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.551333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09143609-dbea-447e-aba8-87564e04383e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:14.551952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09143609-dbea-447e-aba8-87564e04383e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.553611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09143609-dbea-447e-aba8-87564e04383e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.563266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 486/934] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:14.569842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143609-dbea-447e-aba8-87564e04383e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.616195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5e4c-3bda-4fac-a749-5ad258af2480 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.655260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.655838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.656172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.656450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.657481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.660066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.662660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.693743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143609-dbea-447e-aba8-87564e04383e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.728200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.729034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.729321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.729600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.741148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.742606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:14.760701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:14.763931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:14.765215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:14.765215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:14.765215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:14.765215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:14.765215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 487/935] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:14.767369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:14.787430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 449/936] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:14.885443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf95-5ccf-4ee5-8abf-3cd5dc927b65 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:14.916516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:14.932868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:14.933553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:14.933838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:14.934115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:14.934846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:14.935155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:14.936573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:14.950325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 488/937] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:14.956688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.000113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:15.070848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb413e-401a-4bd4-9189-f91cc5893eb5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:15.106683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:15.107663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.107953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.108237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.116457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:15.117928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:15.133260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:15.134197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:15.135917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 450/938] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:17:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:15.140672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.247154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bda1-6572-4946-b2fc-49cbcc1285cc None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:15.284741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:15.285426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.285715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.285988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.286828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:15.287135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:15.288808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:15.311701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 489/939] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:17:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:15.317364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.418719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:15.422690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc382c8-b4d7-4fc2-9135-d63e2a5a4e16 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:15.458230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:15.459024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.459308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.459585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.469831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:15.471884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:15.492335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:15.494372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:15.496699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:15.496699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:15.496699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:15.496699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:15.496699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 451/940] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:15.497470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.542396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:15.621350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86671-38d9-4482-acf7-5fc57b6b332e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:15.669410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:15.670155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.670333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.670610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.671331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:15.671633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:15.673148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369d9c-426a-4096-a1aa-dd433eb88a50 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:15.686235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 490/941] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:15.691962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.701498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53637-319d-41b4-80a6-9edd29d9916b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.701772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53637-319d-41b4-80a6-9edd29d9916b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.702052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53637-319d-41b4-80a6-9edd29d9916b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.703683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 491/942] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:15.710385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414710-713e-4059-964e-5839e1648201 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.710678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414710-713e-4059-964e-5839e1648201 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.710962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414710-713e-4059-964e-5839e1648201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.728719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-65414710-713e-4059-964e-5839e1648201 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:15.730146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-65414710-713e-4059-964e-5839e1648201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:15.812901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 492/943] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:15.817933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c10945-eb5b-4756-bdb0-8445429eebce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:15.833240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414710-713e-4059-964e-5839e1648201 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.855916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:15.856583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:15.856872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:15.857146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:15.864234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:15.865653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:15.867853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:15.881276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:15.887302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:15.888185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 452/944] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:15.889101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:15.910667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:15.965356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414710-713e-4059-964e-5839e1648201 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.006553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.007566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.008063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.009072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.010527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.012833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.014991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING keystone.server.flask.common [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 08:17:16.022094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38382-7d19-4619-a73b-60e461364b51 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.061049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.062046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.062475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.063019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.063883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:16.064081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.sql.core [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:17:16.064081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 08:17:16.064081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [parameters: {'id': '59c761df2c9e4343b78f06aa782b5f2b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 08:17:16.064081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80265) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:17:16.064382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.066069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.084553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 453/945] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:16.086323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c761df2c9e4343b78f06aa782b5f2b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c761df2c9e4343b78f06aa782b5f2b. Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:17:16.089970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result.read() Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 08:17:16.090798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application yield resource Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise self.value Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application session.commit() Jun 17 08:17:16.091739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:17:16.092657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:17:16.095314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result.read() Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:17:16.097316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [parameters: {'id': '59c761df2c9e4343b78f06aa782b5f2b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.099461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:16.102149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59c761df2c9e4343b78f06aa782b5f2b. Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 493/946] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 17 08:17:15 2022] POST /identity/v3/projects => generated 262 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:16.104430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:16.180144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:16.198811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:16.215729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140e47-55e8-46ea-ae1f-448f78343752 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.215915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d353-5d25-45c5-9bc8-53e437971e24 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.252215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.253875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.254155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.254482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.254782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.255826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.256257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.256689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/a8e733e298f84d75adfe1ef616c4574f/roles/5fbb3b8738ac4eae945a34c75d2cdc86` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.259240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=a8e733e298f84d75adfe1ef616c4574f, role_id=5fbb3b8738ac4eae945a34c75d2cdc86)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.261255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9778f8-abf0-4c10-ab62-b0227e28645a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.261974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.263622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:16.279759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:16.282788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:16.284084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.284770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 494/947] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:16.287804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:16.337324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 454/948] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:17:16 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/a8e733e298f84d75adfe1ef616c4574f/roles/5fbb3b8738ac4eae945a34c75d2cdc86 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:17:16.394954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f980e-b269-4834-bb59-6e97aa445fc1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.394954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f980e-b269-4834-bb59-6e97aa445fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.395221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f980e-b269-4834-bb59-6e97aa445fc1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.405430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 455/949] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:16.407225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.407578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.407926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.426258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498f81-2905-4e3e-a93b-7af2ebc1083c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.428722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:16.430448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:16.473200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.474218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.474688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.475138 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.476091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:16.476619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.479015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.505284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 495/950] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:16.514502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 456/951] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:16.538638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:16.542764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:16.683006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797766b-f9c2-4a11-8478-ab420196ea91 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.724867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.726043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.726524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.727010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.727881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.729467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:16.743226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:16.744436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:16.745338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:16.747052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 496/952] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:16.753731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:16.828459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:16.870990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce539-7412-43ae-a45d-a8c72f5c5839 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:16.906271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:16.906945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:16.907225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:16.907500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:16.908223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:16.908649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:16.910410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:16.916219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 457/953] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:16.921757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:17.007622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:17.047711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696737cc-feec-4fc6-a6a0-aa511bb8f8dd None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:17.084825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:17.085960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.086440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.086935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.087932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:17.088432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:17.090132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cbdf4-e764-4c05-9eb8-6442c38dcd02 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:17.096718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 497/954] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:17.106060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:17.175177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d30fd-d00f-473e-8e1e-fe87613410d5 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.175502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d30fd-d00f-473e-8e1e-fe87613410d5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.175744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d30fd-d00f-473e-8e1e-fe87613410d5 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.177431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 498/955] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:17.182449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.182740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.183019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.199948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:17.201693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:17.215112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d5f25-5371-4ce7-bb00-9d2175a417d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:17.246093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:17.256763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:17.261926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.261926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.261926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.261926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:17.261926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:17.285388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 499/956] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:17.307908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:17.349115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 458/957] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:17.387679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:17.433545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc036c-e37d-4cac-87d4-b020c6b33ea2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:17.478619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:17.479808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.480301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.480832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.481747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:17.483429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:17.497897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:17.498985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:17.499812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:17.502868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 500/958] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:17.509133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:17.622660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046b5a-33f3-49fb-ba95-bfc9a34828e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:17.665881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:17.666544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.666822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.667091 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.667792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:17.668093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:17.669491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219eb8-69e5-476a-86ee-abc43eb83340 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:17.675441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 459/959] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:17.681167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:17.787643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7aae-0b20-4c19-adea-03044588df4a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:17.813567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:17.825884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:17.828358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:17.828358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:17.828358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:17.828358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:17.828358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:17.829689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23032a-06d7-4da9-ad1b-5d3c3145f31f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:17.835251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 501/960] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:18.625321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda308a-da34-4350-9279-5e97ac02dcaf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:18.625839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda308a-da34-4350-9279-5e97ac02dcaf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:18.625946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda308a-da34-4350-9279-5e97ac02dcaf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:18.628600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 460/961] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:18.633446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5cfa5-a622-4b26-8d1d-e8262638c626 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:18.633740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5cfa5-a622-4b26-8d1d-e8262638c626 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:18.634021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5cfa5-a622-4b26-8d1d-e8262638c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:18.651213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0dd5cfa5-a622-4b26-8d1d-e8262638c626 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:18.652400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0dd5cfa5-a622-4b26-8d1d-e8262638c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:18.726664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 502/962] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:18.750319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda308a-da34-4350-9279-5e97ac02dcaf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:18.798856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:18.865837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda308a-da34-4350-9279-5e97ac02dcaf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:18.887447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53baa0-12db-4caf-bac4-6f0f3711af35 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:18.887931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53baa0-12db-4caf-bac4-6f0f3711af35 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:18.887931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53baa0-12db-4caf-bac4-6f0f3711af35 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:18.889550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 503/963] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:18.897505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:18.897505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:18.897505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:18.913390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:18.914831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:18.915346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:18.915858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:18.918191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:18.919427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:18.931560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:18.943671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:18.944644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:18.945494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:18.946714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 461/964] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:18.951566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.006307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 504/965] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:19.031576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.068678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679224b-6a2d-41a1-8c9f-fa17fd9d8fa9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.072259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.089999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.110949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.112744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.113279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.113824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.114900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:19.115571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.117684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.129172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 462/966] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:19.134307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.164532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8b9ee-38c1-4899-82c8-78edd0473248 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.216399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.217508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.218000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.218481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.219921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.222428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.245800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57183-8251-408a-8690-40a18e9c89be None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.267329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.sql.core [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:17:19.267329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 08:17:19.267329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [parameters: {'user_id': '941a95709386414c906a0e069cf92b40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 08:17:19.267329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80265) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result.read() Jun 17 08:17:19.278931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:17:19.279938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application yield resource Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise self.value Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application session.commit() Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:17:19.280959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:17:19.281877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:17:19.282818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application result.read() Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:17:19.283744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [parameters: {'user_id': '941a95709386414c906a0e069cf92b40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:19.285575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 08:17:19.287465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 08:17:19.289752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.290662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.290662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.290970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 505/967] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 08:17:19 2022] POST /identity/v3/users => generated 160 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:19.291123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.291123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.294791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.310592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.313161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:19.337562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:19.338485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:19.339396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:19.339396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:19.339396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:19.339396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:19.342512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 463/968] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:19.349928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.368317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.410331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1edd1-f7a9-4fa2-a8b6-d6c5711e138b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.420186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.447279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.448424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.448936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.449390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.454828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ab75-9b98-4e11-ad73-95ea4406d814 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.459447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.461348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:19.477835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:19.478933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:17:19.479863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:19.488243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 506/969] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:19.489360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.492245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.492942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.493222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.493495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.494458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:19.494594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.495854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.512691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 464/970] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:19.514070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.596820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.599204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248fcd-b5db-47e5-a3e0-f1e6309ea943 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.621749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b90ef-a13d-40e0-bc4d-44ec9a1e928b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.641226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.642159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.642590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.643080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.644175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:19.644765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.646446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.658078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.659142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.659299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.659582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.667732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.669200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ebcd8351-446b-4650-971f-0dd4fd85e666 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:19.684528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:19.685741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:17:19.686854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:19.690622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 465/971] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:19.691873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817609c8-5c19-4121-bf00-5421a358f598 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.696690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 507/972] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:19.696945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817609c8-5c19-4121-bf00-5421a358f598 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.696945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817609c8-5c19-4121-bf00-5421a358f598 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.697110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.697185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 466/973] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:19.700519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.700519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.700519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.717514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:19.718753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:19.737649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.800651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 467/974] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:19.823061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.830751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dbdd4-db25-4b52-953a-cacd0f0fdce5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.879274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.880075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.880430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.880806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.882010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:19.882413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.884739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:19.906537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:19.916055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 508/975] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:19.921811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:19.951638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb796-2b00-4ea5-be25-e6a1628d740e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:19.993638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:19.994919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:19.995547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:19.996375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:19.997496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:19.998866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d5377573-d010-4e1c-8fff-841c9194c60a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:20.017541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:20.019245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:20.020067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 468/976] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:20.021288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff86c-d171-43d6-81aa-7e1019567527 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.021288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff86c-d171-43d6-81aa-7e1019567527 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.021505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff86c-d171-43d6-81aa-7e1019567527 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.023012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 469/977] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:20.023193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.024973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceff86c-d171-43d6-81aa-7e1019567527 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.039502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccb02a-84ba-423e-929e-3a5e36f91e58 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.073201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.073899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.074179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.074453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.125352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceff86c-d171-43d6-81aa-7e1019567527 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.141795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.143814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.155623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.160929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.161581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.161862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.165034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.165034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:20.165034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.165034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac4bb5-c326-43aa-86ab-a4932794967a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.168999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 470/978] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:20.170145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.170424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.170692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.187240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:20.188421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:20.228179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.245239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 509/979] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:17:20.246142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.255391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 471/980] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:20.256216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.348821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6dcd-75bb-4267-82dd-3f67290a2048 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.352223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197c48f-8422-44f6-89a7-feddc80c33d1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.377734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.382324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.383168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.383446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.383720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.384766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:20.385071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.386443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.386532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.390327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.390327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.390327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.391371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 510/981] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:20.392113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.399485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.400973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:20.423774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:20.424871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:20.425871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:20.425871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:20.425871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:20.425871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:20.425871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 472/982] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:20.426444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.454339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.506115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5b89-823e-4681-8688-da0db19a513d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.526078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e586e-0cd8-4584-bc22-46079e4521c7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.539092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.539757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.540039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.540313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.541057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.542438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.559437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.560080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.560357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.560656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.561453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] RBAC: Adding query filter params (interface=admin, service_id=7f5eb3f0fae4477d9b281bb3a36d55d4, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:20.561760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.563101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.569103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 473/983] 10.222.0.48 () {56 vars in 1249 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/endpoints?service_id=7f5eb3f0fae4477d9b281bb3a36d55d4&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:20.569862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.610334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.618330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 511/984] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:20 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:20.619192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.677573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a3f4-ebf9-44df-b5a9-e4c7cb04cb79 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.724809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.725481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.725764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.726037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.726766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:20.727069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.728458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.746370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 474/985] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:20.746575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409253-e749-4980-8031-c4d5f66d3971 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.747541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:20.757116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.786184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.786878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.787163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.787445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.788147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.792335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.797758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 512/986] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:17:20.878125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:20.882268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4719ba-f49a-475d-b7f8-c734b8797efb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:20.921192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:20.922011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:20.922377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:20.922580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:20.930523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:20.931985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:20.947417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:20.948394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:20.954084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 475/987] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:20.956330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:21.061172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd2b96-2438-4508-9897-4d70546bf197 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:21.100190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:21.101449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:21.101970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:21.102479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:21.103475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:21.103800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:21.107709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bb682-9f82-4d65-ba12-0bd411ce7e79 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:21.136547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 513/988] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:21.138415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:21.239597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b64a-7791-4133-91fa-e39a97e37850 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:21.273113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:21.273771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:21.274053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:21.274329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:21.275158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] RBAC: Adding query filter params (role.id=5fbb3b8738ac4eae945a34c75d2cdc86, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=a8e733e298f84d75adfe1ef616c4574f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:21.275471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:21.276940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbbc5c-5f19-431a-a44d-5276b276c115 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:21.282974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 476/989] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:21 2022] GET /identity/v3/role_assignments?user.id=a8e733e298f84d75adfe1ef616c4574f&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=5fbb3b8738ac4eae945a34c75d2cdc86 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:22.819349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3c7ba-523a-4ea9-b8ff-a45d68278ff1 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:22.819864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3c7ba-523a-4ea9-b8ff-a45d68278ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:22.819941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3c7ba-523a-4ea9-b8ff-a45d68278ff1 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:22.821449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 514/990] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:22.826508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:22.826901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:22.827061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:22.843829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:22.845041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:22.862186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:22.922211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 477/991] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:22.943783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f553d9-8763-4ce0-b4cd-df486d1c70dd None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:22.944145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f553d9-8763-4ce0-b4cd-df486d1c70dd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:22.944513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f553d9-8763-4ce0-b4cd-df486d1c70dd None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:22.944729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:22.945915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 515/992] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:22.950982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:22.951270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:22.951551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:22.968243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:22.969792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:22.998543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.045756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 516/993] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:23.056047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10704ef7-77b8-481d-b943-7855c7d52241 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.069275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.091451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.092552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.093014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.093479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.094136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.096339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:23.108758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:23.109757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:23.115702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 478/994] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:23.116482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.139254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.184479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640b9de-3cd4-4eb6-a094-b0265b83cd0b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.220710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.221521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.221801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.222071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.222715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.223133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d578f1-051e-4dca-9a44-353721c73677 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.224076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:23.238150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:23.239181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:23.240066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 517/995] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:23.245224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.261200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.261872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.262156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.262432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.263142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:23.263447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.264845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.270258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 479/996] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:23.275726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.281469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.357621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9d94-1c1c-4a7f-bbd9-5da69bc954f0 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.362458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.387110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af80081-81b4-4bba-9cb5-afff496f8b1d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.402871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.403903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.404360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.404806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.405770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:23.406220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.407846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.418998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 518/997] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:23.419994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.424391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.425094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.425381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.425658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.426367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:23.426673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.428045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3bf27-fa74-40ad-8140-8d189fa62cf4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.433303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 480/998] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:23.439862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c34ec-7147-4034-9535-124a5909ff2f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.440152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c34ec-7147-4034-9535-124a5909ff2f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.440426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c34ec-7147-4034-9535-124a5909ff2f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.441746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 481/999] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:23.442433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c34ec-7147-4034-9535-124a5909ff2f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.517547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.526982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0200ff-f865-452d-b0df-4bc81fbf679d None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.541716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c34ec-7147-4034-9535-124a5909ff2f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.561726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.562391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.562673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.562948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.563657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:23.563968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.566059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a91a9a-c9db-436a-af17-2ace2d564ae2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.570824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 519/1000] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:23.572061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.572354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.572673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.577039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.577697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.577977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.578254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.579039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] RBAC: Adding query filter params (interface=public, service_id=273b34095d884fb8bf2211b114d636cc, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:23.579349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.580920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.590819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 482/1001] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/endpoints?service_id=273b34095d884fb8bf2211b114d636cc&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:23.590819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.591039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:23.591039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:23.599450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.655375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 520/1002] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:23.656129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.687718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa7b6d-e197-4c10-ad71-09a0cfe2f176 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.721268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.721913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.722201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.722477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.723214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.724593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.741471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:23.756940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b65ed-f517-4dad-baf2-02a91ec48e44 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.788969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.789621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.789898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.790166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.790878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.792221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.798209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 521/1003] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:17:23.800000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:23.829153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 483/1004] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:23.932457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd213f-8c6b-49c7-9d2d-df666abe375e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:23.980865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:23.981684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:23.981971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:23.982242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] PATH_INFO: `/v3/services/image` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:23.982894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:23.984283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:23.997901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:23.999152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:24.000168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 522/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 08:17:23 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:24.007853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:24.080079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:24.171722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcdfa-d61d-4b3f-83a5-e67447c966b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:24.206678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:24.207340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:24.207616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:24.207896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:24.208641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:24.208945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:24.210295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523170a-bea5-41a6-a038-e162781acd09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:24.215325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 484/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:24.221940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:24.233194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:24.325268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158a8b-fbc7-4e45-8872-e9a577391455 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:24.360058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:24.360749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:24.361030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:24.362362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:24.363074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] RBAC: Adding query filter params (type=image) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:24.363378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:24.364761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502691-9265-4a70-8976-516814ca5056 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:24.376566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 523/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:25.972376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab46a6-c301-4bf7-aed6-547b3bbc8dcd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:25.972997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab46a6-c301-4bf7-aed6-547b3bbc8dcd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:25.972997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab46a6-c301-4bf7-aed6-547b3bbc8dcd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:25.974604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 485/1008] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:25.980187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:25.980771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:25.980771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:25.998856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:26.000052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:26.030445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf2c8-5ab3-44b7-892f-d7165748db33 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.030735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf2c8-5ab3-44b7-892f-d7165748db33 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.031012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf2c8-5ab3-44b7-892f-d7165748db33 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.032565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 486/1009] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:26.037419 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.037708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.037988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.056597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:26.057801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:26.072527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 524/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:26.093338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.095752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.148525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 487/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:26.171977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.214947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869958f3-3d36-4cbd-825b-757b0563ca0e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.235149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.251006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.251866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.252362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.252776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.253426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.254802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:26.267099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:26.268201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:26.269509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 525/1012] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:26.274695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.280239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75e22-08c3-45d3-8c80-799aa1f61270 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.315002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.315798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.316079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.316352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.317579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.319075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.320737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 488/1013] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:26.326342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.346867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.382312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18d58-d1a3-4242-9d9c-e333bb9c758e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.420365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.421076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.421339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.421611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.422361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:26.422606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.424951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.431481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40e4f-4120-422c-9d38-670072841238 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.431725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 526/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:26.437332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.468165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.474883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.475569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.475856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.476132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.476905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.478381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055cd9-aa75-42d1-a6da-c52e2c39a62a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.549162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6790a-a5bc-4515-a4fb-44796a7f19b7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.566589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 489/1015] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:26 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:17:26.568047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b1e2-5d11-49d8-84c5-7ec51d92c603 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.568339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b1e2-5d11-49d8-84c5-7ec51d92c603 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.568665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b1e2-5d11-49d8-84c5-7ec51d92c603 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.569984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 490/1016] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:26.578418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.578719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.578994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.581491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.588662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.589362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.589648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.589926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.590653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:26.590965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.592384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.603969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 527/1017] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 08:17:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:26.610394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:26.610394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:26.610671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.678801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 491/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:26.702704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:26.721468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aeecc-086f-49f2-b811-82bc0626455e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.772524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.773188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.773467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.773746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.774505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.775857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047ada-40c2-4fac-bfc3-77f3eec16a9b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.819519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2773-59e2-4605-8c68-52508e0f1b64 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:26.833014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:26.852649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 528/1019] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:17:26.859829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:26.860535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:26.860820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:26.861632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:26.862375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:26.863798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d470f-f697-4b67-a14a-2c30afc5d22b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:26.949422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 492/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:26 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:17:28.753311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3175c-69ed-4bbf-9b4c-a7266dae2206 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:28.753861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3175c-69ed-4bbf-9b4c-a7266dae2206 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:28.753861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3175c-69ed-4bbf-9b4c-a7266dae2206 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:28.755414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 529/1021] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:28.760805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:28.761202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:28.761364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:28.778662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:28.779836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:28.856626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 493/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:28.878260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3175c-69ed-4bbf-9b4c-a7266dae2206 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:28.940481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:28.991793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3175c-69ed-4bbf-9b4c-a7266dae2206 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.025550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.026441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.027221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.027516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.028748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.030196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80f347-aa98-4eac-9851-29602eb99772 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.031974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 530/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:29.038234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.114149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7bef-1a1d-470f-a62f-32b9a8ae25b0 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.114439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7bef-1a1d-470f-a62f-32b9a8ae25b0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.114744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7bef-1a1d-470f-a62f-32b9a8ae25b0 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.116304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 531/1024] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:29.119529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1a23-34df-4a48-b53d-5e318ceb5d22 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.119891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1a23-34df-4a48-b53d-5e318ceb5d22 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.120169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1a23-34df-4a48-b53d-5e318ceb5d22 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.121439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 532/1025] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:29.122491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08347-97c6-451d-95f4-8b7d3dea45d6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.122774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08347-97c6-451d-95f4-8b7d3dea45d6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.123099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08347-97c6-451d-95f4-8b7d3dea45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.140481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0df08347-97c6-451d-95f4-8b7d3dea45d6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:29.141690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0df08347-97c6-451d-95f4-8b7d3dea45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:29.143012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.149221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363571d1-306b-4a1c-ae3e-5c6e8428bfb0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.186462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.187134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.187417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.187693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.188426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.190534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.216810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 533/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:29.219911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4f25-c687-4856-971c-baab37261372 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.219911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4f25-c687-4856-971c-baab37261372 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.219911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4f25-c687-4856-971c-baab37261372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.234553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-966e4f25-c687-4856-971c-baab37261372 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:29.235772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-966e4f25-c687-4856-971c-baab37261372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:29.279878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.302132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 534/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:29.307451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4f25-c687-4856-971c-baab37261372 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.316760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 494/1028] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:17:29 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:29.326926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.415983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4f25-c687-4856-971c-baab37261372 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.461934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b14d0-8551-4dff-96a8-a0527646ec48 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.462983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.463828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.464111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.464391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.475699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:29.484015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:29.485083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:29.486442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 535/1029] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:29.491746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.509797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.510939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.511227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.511504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.512171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.513596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:29.526525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:29.527708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:29.529804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 495/1030] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:29.536038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.541701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.555252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.614928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565a5e-cd3b-4ee9-809c-9a33059d5ccb None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.639023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49a2f-e0a8-4156-ab57-e78ee9f245d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.650617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.651286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.651574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.651849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.652631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:29.662733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.662733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.663159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 536/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:29.668292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.680068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.681153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.682160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.682794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.684235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:29.684579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.685955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.690936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 496/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:29.696450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.775805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.778969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf8b6-27d7-4e55-829f-006a26644a10 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.785839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:29.807572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd2d5-d06b-4829-abd4-1269b1f9ee0a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.816363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.818638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.818638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.818638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.829943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.831571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.843069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beecd13-5435-4145-8540-16d15124583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:29.843937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beecd13-5435-4145-8540-16d15124583f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:29.844368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beecd13-5435-4145-8540-16d15124583f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:29.844843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beecd13-5435-4145-8540-16d15124583f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:29.846286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beecd13-5435-4145-8540-16d15124583f None admin] RBAC: Adding query filter params (type=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:29.846741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beecd13-5435-4145-8540-16d15124583f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:29.848259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beecd13-5435-4145-8540-16d15124583f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:29.851591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:29.852739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:29.853817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:29.853817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:29.853817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:29.853817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:29.853817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 537/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:29.856365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 497/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:29.858611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.861802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beecd13-5435-4145-8540-16d15124583f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:29.973221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f22e3-a503-4083-b250-68e2e678a87e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:29.973827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beecd13-5435-4145-8540-16d15124583f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.010800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.011028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.011459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.011560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.011740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.011984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.012088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.012381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.012825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] RBAC: Adding query filter params (interface=public, service_id=af0b6d4c620645caa82e077ccaac8d00, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:30.013140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.013273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:30.013686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.014499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.015320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.020796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 498/1035] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/endpoints?service_id=af0b6d4c620645caa82e077ccaac8d00&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:30.026038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.033111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 538/1036] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:30.033949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.039863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.048774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.137118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86becc8c-b548-4ca7-83fd-3872c4bbf2c2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.137537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32040-3b6c-48e5-a5ff-f2d7cde697a4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.172449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.173136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.174007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.174178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.174399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.174946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.175112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.175265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.175502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.176447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.183160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.183734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 499/1037] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:17:30.184784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:30.200406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:30.201682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:30.202753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:30.204932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 539/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:30.208036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.286590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.319126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b07f7-2ee7-4713-8b9d-ada7fc4403dd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.359047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.359719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.360005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.360283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.361187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:30.361610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.363063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.381434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 500/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:30.387589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.460861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.494037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a2c91-ed64-451b-aabe-6327141606b6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.529279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.529943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.530291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.530573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.601226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.602700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.672592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.703022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 540/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:30.709578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.808802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cc83-c882-4b90-8b35-b5319a102b30 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:30.836348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:30.844283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:30.845402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:30.845729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:30.853462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:30.856578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:30.859035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:30.878295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:30.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:30.885050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:30.885050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:30.885050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:30.885050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:30.885050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 501/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:30.886854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:30.988443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c0317-908c-42db-95ca-4adf68eb6ed2 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.023310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.023970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.024250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.024546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.025256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:31.025556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:31.026916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:31.043077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 541/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:31.047925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:31.150736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe81d-966c-4fbe-896b-e46d304a8baa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.192337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.193742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.194258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.194776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.203029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:31.204547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:31.226717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:31.228038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:31.229369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:31.232818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 502/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:31.234271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:31.268462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:31.338564 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545bde-a10a-44d3-bfcf-f697eef7f8bf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.372689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.373357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.373637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.373909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.374694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:31.374999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:31.377051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2132ad-f881-482a-8b18-19574958585f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:31.390816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 542/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:31.395628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:31.439730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:31.527565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eed0d6-462e-4916-a36a-966265881f7d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.543470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41198d-ce88-43ce-8d1c-ac49c5ed0903 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.543771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41198d-ce88-43ce-8d1c-ac49c5ed0903 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.544029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41198d-ce88-43ce-8d1c-ac49c5ed0903 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.547212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 543/1045] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:31.552885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.553177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.553458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.570252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:31.571454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:31.575130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.575978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.576421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.576865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.577870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] RBAC: Adding query filter params (role.id=5fbb3b8738ac4eae945a34c75d2cdc86, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:31.578332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:31.580464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:31.587880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 503/1046] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:31 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=5fbb3b8738ac4eae945a34c75d2cdc86 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:31.652842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 544/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:31.669442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:31.778136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca6f8-9fcc-46bb-a90a-47b4c68f88f7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.780347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:31.811438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.812240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.812518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.812793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.822986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:31.831487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:31.832481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:31.833357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 504/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:31.842607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:31.866253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:31.952982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98d6b-2c12-468b-8de3-005c2c3864fa None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:31.987293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:31.987975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:31.988257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:31.988561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:31.989318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:31.989628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:31.990995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:31.999424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 545/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:32.005659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.109795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7173cf-da05-4b23-8c6f-37ac0096b3a0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.144473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.145370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.145651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.145921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] PATH_INFO: `/v3/users/8c628d3cca364374a271ad75ce0aed59` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.160122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] RBAC: Authorizing `identity:get_user(user_id=8c628d3cca364374a271ad75ce0aed59)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.161610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71563ed3-b031-41f4-b859-c8fd6671d380 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.163525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 505/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/users/8c628d3cca364374a271ad75ce0aed59 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:32.169033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.256259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.273842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98c14a-1328-445a-beac-c15ef508ae09 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.311374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.312032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.312316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.312620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.343795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dca12-7c0a-488f-bdbd-b4aeb96a6010 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.344112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dca12-7c0a-488f-bdbd-b4aeb96a6010 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.344361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dca12-7c0a-488f-bdbd-b4aeb96a6010 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.346188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 506/1051] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:17:32.351200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.351484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.351759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.368186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:32.369326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:32.385665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.386715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.387136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.439659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 507/1052] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:32.462716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.476913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.499534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 546/1053] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:32.507319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.577591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a024d-bc7d-4f20-b8f2-7038b480ad73 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.619779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daf362-94f8-4968-94b8-ae5f2db300ee None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.622187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.623273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.623405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.623647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] PATH_INFO: `/v3/services/image` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.624409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.626037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:32.639762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:32.641624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:32.643012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 508/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:32.647640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.667591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.670500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.671457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.672322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.672644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.674535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.676734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.679283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 547/1055] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:32.689533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.768304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.783426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa547eb-8cec-4a87-bd64-9138d5daa562 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.833112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.834264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.835019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.835371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.836689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:32.837082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.838812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.840890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf71ee-37cc-458e-bbf9-80eeb8b67cea None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:32.856163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 509/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:32.857434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:32.905660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:32.908564 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:32.909083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:32.909560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:32.910757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b1c998123313428f9ae7d427b6e26b9a, user.id=8c628d3cca364374a271ad75ce0aed59) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:32.911274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:32.912984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:32.919646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 548/1057] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/role_assignments?user.id=8c628d3cca364374a271ad75ce0aed59&scope.project.id=b1c998123313428f9ae7d427b6e26b9a&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:32.964144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:32.991543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ad863-bbd5-46cf-9938-7656487c3930 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:33.035811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:33.036934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:33.037426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:33.037900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:33.038830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] RBAC: Adding query filter params (type=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:33.039338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:33.041009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f135b-6037-4934-a547-c41d842e55fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:33.047927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 510/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:33.056081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:33.195386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72874b-1b16-46f2-b27c-c78a20abb169 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:33.211901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:33.230602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:33.231275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:33.231558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:33.231835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:33.232661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:33.234007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d463e3-4251-4ddc-89d3-57e492127231 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:33.301421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 549/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:17:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:33.894392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f34f3-6862-4c5a-ba82-1decf029a8a3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:33.894914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f34f3-6862-4c5a-ba82-1decf029a8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:33.894991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f34f3-6862-4c5a-ba82-1decf029a8a3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:33.896455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 511/1060] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:33.902017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:33.902306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:33.902841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:33.920465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:33.921694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:33.996521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 550/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:34.020580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f34f3-6862-4c5a-ba82-1decf029a8a3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.153264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f34f3-6862-4c5a-ba82-1decf029a8a3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:34.190287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:34.191097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:34.191376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:34.191642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:34.201858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:34.210401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:34.211405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:34.212265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 512/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:34.217838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.315719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:34.320078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bcf61-10bd-4317-8dad-d851bc8a6b83 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:34.352668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:34.353346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:34.353632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:34.353910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:34.354685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:34.355000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:34.356418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:34.369412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 551/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:34.370892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.374745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:34.475732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf3d9-b96c-4eed-ae61-c4d2eca4454e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:34.513644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:34.514744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:34.515105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:34.515380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:34.528035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:34.529541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:34.547442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:34.548965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:34.554916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:34.554916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:34.554916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:34.554916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:34.554916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 513/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:34.555213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.655206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182831f8-4fdc-42d5-8b5b-fd3b5a529273 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:34.689360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:34.690031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:34.690314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:34.690590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:34.691315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:34.691623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:34.693038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:34.705061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 552/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:34.710579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.769784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:34.813973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859775f8-d9a5-44be-bd85-5583596efcb2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:34.848523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:34.849318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:34.849602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:34.849879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:34.857606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:34.859046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:34.872982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:34.873947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:34.874879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:34.879076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 514/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:34.880303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:34.908146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:34.987143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597234-87fd-43cf-bbde-fc02cd5cf975 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.022260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.022858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.023144 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.023417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.024257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:35.024595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.026123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1f75e-b090-4f7f-b5ff-6f73a63a642d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.048684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 553/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:17:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:35.050308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.159921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831545f3-70ef-4919-a59d-52b28c7f4e13 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.176687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.187691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d9ea-d6e6-453e-857b-f313bac6b51c None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.187994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d9ea-d6e6-453e-857b-f313bac6b51c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.188256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d9ea-d6e6-453e-857b-f313bac6b51c None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.192108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 554/1068] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:35.194923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.195209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.195376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.195492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.196134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.196411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.196771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.209104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.210596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.212358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:35.213463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:35.229215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:35.230149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:35.231033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:35.231033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:35.231033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:35.231033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:35.231033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 515/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:35.236925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.290411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 555/1070] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:35.313114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.323627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.346762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803409a-a232-490e-a21b-b4a4c7b80eb1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.385500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.386167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.386445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.386724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.387440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:35.387741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.389152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.402214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 516/1071] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:35.407952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.417635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315d4f-b0b6-45f1-8451-390802fd6bd8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.436563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.457395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.458227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.458506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.458791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.472616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:35.480310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:35.481277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:35.482108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 556/1072] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:35.487863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.518712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee884b92-0e8e-4dc2-9fd1-cd96d6d88f2a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.553585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.554276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.554555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.554820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.555107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.561319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.562790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c1ca3372-5dae-4b14-9635-056a258c6d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:35.576876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:35.577851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:35.578754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 517/1073] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:35.580158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63cb2a-d9f8-488c-acd1-b1d61a6a7e64 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.580158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63cb2a-d9f8-488c-acd1-b1d61a6a7e64 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.580471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63cb2a-d9f8-488c-acd1-b1d61a6a7e64 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.581751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 518/1074] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:35.585335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63cb2a-d9f8-488c-acd1-b1d61a6a7e64 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.592394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffce7f-450c-44a2-856d-cbd3d542e9a1 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.626859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.627537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.627819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.628091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.628863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:35.629170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.630519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3cc4b-b043-4108-a27d-bc2ed75d344e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.638636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 557/1075] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:35.639806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.640091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.640360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.657128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:35.659156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:35.673288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.686269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63cb2a-d9f8-488c-acd1-b1d61a6a7e64 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.719198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.720404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.720710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.720986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.721767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:35.722078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.723508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.724120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 558/1076] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:35.724985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.736585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 519/1077] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:35.742164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.783239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:35.823176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e37f-9943-438f-a5f9-ea27f7afb48d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.840675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fffe20-efc4-4383-87ad-d247a5bde4d9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.855879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.856773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.857051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.857322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] PATH_INFO: `/v3/users/8c628d3cca364374a271ad75ce0aed59` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.858518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] RBAC: Authorizing `identity:get_user(user_id=8c628d3cca364374a271ad75ce0aed59)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.859952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.861883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 559/1078] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/users/8c628d3cca364374a271ad75ce0aed59 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:35.862632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.878449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:35.879333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:35.879611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:35.879884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/5fbb3b8738ac4eae945a34c75d2cdc86` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:35.882136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=d125909b383a44b49e94715bde34866c, role_id=5fbb3b8738ac4eae945a34c75d2cdc86)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:35.883563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:35.971010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 520/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:17:35 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/d125909b383a44b49e94715bde34866c/roles/5fbb3b8738ac4eae945a34c75d2cdc86 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:17:35.971410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6242d9e-3e2b-47bb-912b-39c15c356caf None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:35.971838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:35.984667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:36.003952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:36.012910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:36.013641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:36.013923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:36.014199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:36.089399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d9f4f-ac86-487b-bc25-68c8a3393e60 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:36.096660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:36.096660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:36.133273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:36.134398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:36.134689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:36.134986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:36.138523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:36.140118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:36.141331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 521/1080] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:36.147519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:36.203609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 560/1081] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:36.210123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:36.234763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:36.239254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:36.259607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121253e-0ed3-447d-bc98-8dca4a8d2434 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:36.309866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:36.310750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:36.311030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:36.311301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a/users/8c628d3cca364374a271ad75ce0aed59/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:36.313438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] RBAC: Authorizing `identity:create_grant(project_id=b1c998123313428f9ae7d427b6e26b9a, user_id=8c628d3cca364374a271ad75ce0aed59, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:36.315444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:36.324984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ccc0-a9e7-41d6-afd5-2a5e2d9bbd80 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:36.360333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:36.361136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:36.361355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:36.361634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:36.366614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 522/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:17:36 2022] PUT /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a/users/8c628d3cca364374a271ad75ce0aed59/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:17:36.381836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:36.383370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-817484f3-7c5e-45c6-9e88-921bd1a5a279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:36.405097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:36.406081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:36.407049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:36.407049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:36.407049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:36.407049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:36.408844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 561/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:36.413368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:36.525744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d28689-1eb5-46dc-a923-5d488f1ad2bc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:36.564706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:36.565208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:36.565544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:36.565822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:36.566545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:36.566852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:36.568217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1368827-d6a6-4227-8bc3-fb6dbd9c818f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:36.570526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:36.580461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 523/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:38.099244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e693-a558-41bf-b472-3c8a0e6a90c2 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.099764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e693-a558-41bf-b472-3c8a0e6a90c2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.099886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e693-a558-41bf-b472-3c8a0e6a90c2 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.101202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 562/1085] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:38.106257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.106651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.106814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.123918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:38.125126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:38.190814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 524/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:38.214136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e693-a558-41bf-b472-3c8a0e6a90c2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.293729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.313523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e693-a558-41bf-b472-3c8a0e6a90c2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.347644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.348458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.348772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.349046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.358827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-8ff4081b-dc1e-455d-81ea-e428d64ab3ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:38.367478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:38.368617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:38.369456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 563/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:38.374682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.475726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76b8e-3e36-4c12-b879-9996d84aba8c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.501527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.510444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.514320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.514479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead6f-7e8e-4d85-a14c-60c73a8293b1 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.514579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.514579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.514738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead6f-7e8e-4d85-a14c-60c73a8293b1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.514738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead6f-7e8e-4d85-a14c-60c73a8293b1 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.514899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:38.514899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:38.515051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 564/1088] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:38.515132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:38.518794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.519083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.519367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.527695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 525/1089] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:38.528732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.540548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:38.541768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:38.607623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 565/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:38.628506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c268-5704-4ab4-9eff-51c0954f5b43 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.630817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.663244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.664024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.664295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.664597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.675415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:38.676881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:38.694361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:38.695416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:38.696463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:38.696463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:38.696463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:38.696463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:38.696463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 526/1091] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:38.699857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.701384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.731921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277b51-9ad0-46ca-a2ae-dbd040e758b5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.743448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.765479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.766276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.767135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.767410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.777477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:38.785847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:38.786957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:38.787801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 566/1092] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:38.792784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.807592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876d598-7b7f-4490-80ad-7a270786ea08 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.841469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.842114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.842402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.842680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.843422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:38.843731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:38.845756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:38.856867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 527/1093] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:38.862479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.892259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261e8f-3001-480e-865b-bbfd9c5b7b1a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.923647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.929480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.930149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.930435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.930712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:38.931459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:38.931802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:38.933172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:38.942632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 567/1094] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:38.948224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:38.960035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:38.963040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d1f40-5a52-4c7e-96fa-d2796672fe67 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:38.996397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:38.997153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:38.997495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:38.997778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.005885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.007364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:17:39.022289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:39.023347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:39.024293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 528/1095] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:39.029094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.051406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ba186-9048-49e7-ae5b-70d6e12f5e3e None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.086387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.087258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.087542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.087840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] PATH_INFO: `/v3/users/8c628d3cca364374a271ad75ce0aed59` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.089073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] RBAC: Authorizing `identity:get_user(user_id=8c628d3cca364374a271ad75ce0aed59)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.090527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.092167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 568/1096] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:38 2022] GET /identity/v3/users/8c628d3cca364374a271ad75ce0aed59 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:39.098015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.127778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883d05-651e-480b-95c2-ff1cf264bd82 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.157287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.162450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.163116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.163398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.163680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.164533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:39.164885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.170469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.183601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 529/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:39.190094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.197762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5ee50-9bf8-4f9d-8503-4902a6682e96 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.208340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.236013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.237181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.237709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.238207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.292309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3335-091e-45f5-b8df-6992381efdcc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.316243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.317743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.326347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.326997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.329276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.329276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.375073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.394291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.395752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.413372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.416455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 569/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:17:39.422279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.499421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 530/1099] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:17:39.500589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.522113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b0fc8-f3b2-407b-8da3-a46f73c3969f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.556277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.557096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.557382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.557655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.558823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.560259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.561993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 570/1100] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:39.570376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.596867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddaf68-505e-4cd7-a1bb-393478faebf2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.598151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.613864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.630214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.631008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.631284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.631557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.642068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.643519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:17:39.661140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:39.662208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:39.663450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:17:39.663450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:17:39.663450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:17:39.663450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:39.663450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 531/1101] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:17:39.667875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.671752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed47e9-b651-4ccc-8bea-d40d065413ab None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.705946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.706597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.706882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.707156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.707979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b1c998123313428f9ae7d427b6e26b9a, user.id=8c628d3cca364374a271ad75ce0aed59) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:39.708288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.709823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.715721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 571/1102] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/role_assignments?user.id=8c628d3cca364374a271ad75ce0aed59&scope.project.id=b1c998123313428f9ae7d427b6e26b9a&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:39.770980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab82d8-0878-467c-9fc1-eb651277df30 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.807366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.807955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.808237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.808530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.809267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:39.809571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.810959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.823613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 532/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:39.829363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:39.925189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:39.936007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962f08-f051-4063-ad93-4d57562ca81c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:39.972244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:39.973070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:39.973353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:39.973626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:39.980183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:39.981664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:17:39.995829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:39.996801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:17:39.997674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 572/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:40.003480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:40.034480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:40.103636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d451f2-bdf1-4a1b-9974-9b1b50ae0a0f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:40.136949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:40.137605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:40.137884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:40.138153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:40.138937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:40.139241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:40.140682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d361a0-b119-4372-b8bc-dd553ed095b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:40.152320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 533/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:40.159036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:40.264739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c734-7b5e-49ba-b478-6cceb76cd269 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:40.298280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:40.299323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:40.299663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:40.299938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:40.300796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] RBAC: Adding query filter params (role.id=5fbb3b8738ac4eae945a34c75d2cdc86, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=d125909b383a44b49e94715bde34866c) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:40.301103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:40.302515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23dbd-2702-44b7-a644-3085adc77767 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:40.308402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 573/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:40 2022] GET /identity/v3/role_assignments?user.id=d125909b383a44b49e94715bde34866c&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=5fbb3b8738ac4eae945a34c75d2cdc86 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:17:41.895847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82728-b2a2-4526-9ce8-e1a011a14625 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:41.896371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82728-b2a2-4526-9ce8-e1a011a14625 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:41.896371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82728-b2a2-4526-9ce8-e1a011a14625 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:41.897773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 534/1107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:41.902878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:41.903284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:41.903430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:41.920351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:41.921563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:41.933946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:41.992040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 574/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:42.016651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82728-b2a2-4526-9ce8-e1a011a14625 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:42.105614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:42.116280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82728-b2a2-4526-9ce8-e1a011a14625 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:42.149296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:42.150012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:42.150294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:42.150568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:42.151728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:42.153284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fc295-cbad-4e10-a3c6-72ac0d40f549 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:42.154879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 535/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:42.161108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:42.255580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347f4e-4dff-4419-a514-a23caaf71e89 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:42.290370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:42.291042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:42.291324 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:42.291599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:42.292313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:42.293780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ff270-282c-4e51-9ce4-45b4e2f87b49 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:42.369877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 575/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:17:42 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:44.536539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b96fb-cef8-41b0-ac8a-014519fa78f4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:44.537068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b96fb-cef8-41b0-ac8a-014519fa78f4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:44.537156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b96fb-cef8-41b0-ac8a-014519fa78f4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:44.538463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 536/1111] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:44.543581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:44.543997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:44.544146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:44.549698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:44.561320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:44.562499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:44.628897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 576/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:17:44.652351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b96fb-cef8-41b0-ac8a-014519fa78f4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:44.753322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b96fb-cef8-41b0-ac8a-014519fa78f4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:44.785570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:44.786413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:44.786746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:44.786974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] PATH_INFO: `/v3/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:44.788448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] RBAC: Authorizing `identity:get_role(role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:44.789839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:44.791196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 537/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:44 2022] GET /identity/v3/roles/b5c3b136cc84423fb874b4d72253033e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:44.797054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:44.893561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d4d8-03d1-48b2-82af-a0ed395b27be None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:44.922234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:44.927701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:44.928600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:44.928886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:44.929160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] PATH_INFO: `/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:44.942268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] RBAC: Authorizing `identity:get_user(user_id=ec8bd792632b4ec2b0821d596ef6c2bc)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:44.943708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:44.945387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 577/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:44 2022] GET /identity/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:44.951591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:44.978572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:45.048991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d610cb-fa30-4a8e-8fb6-6e8f72c52496 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:45.081441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:45.082078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:45.082360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:45.082634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:45.148570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:45.150013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:45.176037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:45.245913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 538/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:45.251894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:45.352631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed837b-6a10-4476-bb71-05792cec5165 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:45.386002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:45.386866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:45.387152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:45.387426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:45.388641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:45.390093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252560d-02b7-4b4b-87d6-53158bee08f5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:45.394617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 578/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:45 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:45.398736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:45.494744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d6c1-ff8b-477d-88aa-016bd2fb008f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:45.519344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:45.527501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:45.528142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:45.528423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:45.528737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:45.529559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=b1c998123313428f9ae7d427b6e26b9a, user.id=ec8bd792632b4ec2b0821d596ef6c2bc) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:45.529871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:45.531297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af15d5-73e8-4805-ab0d-38f61a64e47e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:45.536720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 539/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:45 2022] GET /identity/v3/role_assignments?user.id=ec8bd792632b4ec2b0821d596ef6c2bc&scope.project.id=b1c998123313428f9ae7d427b6e26b9a&role.id=b5c3b136cc84423fb874b4d72253033e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:47.661819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765179fe-4e75-4199-a040-cc7d95b660cc None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:47.662351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765179fe-4e75-4199-a040-cc7d95b660cc None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:47.662351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765179fe-4e75-4199-a040-cc7d95b660cc None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:47.663767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 579/1118] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:47.669099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:47.669511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:47.669659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:47.686568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:47.688458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:47.752777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 540/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:47.775861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765179fe-4e75-4199-a040-cc7d95b660cc None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:47.832915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:47.873287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765179fe-4e75-4199-a040-cc7d95b660cc None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:47.908327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:47.909216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:47.909503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:47.909779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] PATH_INFO: `/v3/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:47.911264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] RBAC: Authorizing `identity:get_role(role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:47.912771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:47.914368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 580/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:47 2022] GET /identity/v3/roles/b5c3b136cc84423fb874b4d72253033e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:47.920453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:48.033878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd58-9f0e-4929-9d9a-bb340a5a579d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:48.054430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:48.067862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:48.068758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:48.069036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:48.069305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] PATH_INFO: `/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:48.070469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] RBAC: Authorizing `identity:get_user(user_id=ec8bd792632b4ec2b0821d596ef6c2bc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:48.071886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:48.073516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 541/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:47 2022] GET /identity/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:48.079340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:48.177098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ed25-5628-4147-9cfd-4eedf37c0e76 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:48.200677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:48.209152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:48.210003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:48.210282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:48.210552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:48.213482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:48.213482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fea2b8-5220-428c-ada0-e9432e9e5fd7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:48.214913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 581/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:48 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:48.221437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:48.319683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1692c2-919b-4794-86d0-6ad3558adb08 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:48.353505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:48.354371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:48.354652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:48.354924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a/users/ec8bd792632b4ec2b0821d596ef6c2bc/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:48.357103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1c998123313428f9ae7d427b6e26b9a, user_id=ec8bd792632b4ec2b0821d596ef6c2bc, role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:48.358531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c9f2d-0dec-4e32-8507-2e177c839b84 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:48.481930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 542/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:17:48 2022] PUT /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a/users/ec8bd792632b4ec2b0821d596ef6c2bc/roles/b5c3b136cc84423fb874b4d72253033e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:17:50.608183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca4b9-1ca7-4c0e-bcee-a23dfcf4aa89 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:50.608775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca4b9-1ca7-4c0e-bcee-a23dfcf4aa89 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:50.608775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca4b9-1ca7-4c0e-bcee-a23dfcf4aa89 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:50.610773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 582/1124] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:50.615815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:50.616189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:50.616379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:50.633242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:50.634685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:50.677571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:50.700114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 543/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:50.723256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ca4b9-1ca7-4c0e-bcee-a23dfcf4aa89 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:50.823009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ca4b9-1ca7-4c0e-bcee-a23dfcf4aa89 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:50.855066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:50.855918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:50.856198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:50.856470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] PATH_INFO: `/v3/roles/b5c3b136cc84423fb874b4d72253033e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:50.857970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] RBAC: Authorizing `identity:get_role(role_id=b5c3b136cc84423fb874b4d72253033e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:50.859943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:50.861367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 583/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:50 2022] GET /identity/v3/roles/b5c3b136cc84423fb874b4d72253033e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:50.867047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:50.963797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda802f3-1aa8-49ec-a09d-7d886bc46ab2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:50.996342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:50.997220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:50.997499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:50.997769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] PATH_INFO: `/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:50.998945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ec8bd792632b4ec2b0821d596ef6c2bc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:51.000402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:51.002028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 544/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:50 2022] GET /identity/v3/users/ec8bd792632b4ec2b0821d596ef6c2bc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:51.007863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:51.067884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:51.105476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1cef-902b-47a8-a40b-21b6155d3bf5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:51.138195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:51.138781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:51.139065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:51.139343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:51.203892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:51.205356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:51.262390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:51.300871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 584/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:51.306817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:51.352833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:51.405726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785402a8-ff78-413b-aa53-51c04ada03c3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:51.437855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:51.438696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:51.438976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:51.439249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] PATH_INFO: `/v3/projects/b1c998123313428f9ae7d427b6e26b9a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:51.440415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] RBAC: Authorizing `identity:get_project(project_id=b1c998123313428f9ae7d427b6e26b9a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:51.441866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1699b-c633-45f9-a06a-fdd7ca62323a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:51.443545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 545/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:51 2022] GET /identity/v3/projects/b1c998123313428f9ae7d427b6e26b9a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:51.449652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:51.545122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045f48-8a67-4b64-a617-2c938367ea6b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:51.576789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:51.577429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:51.577711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:51.578565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:51.579328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] RBAC: Adding query filter params (role.id=b5c3b136cc84423fb874b4d72253033e, scope.project.id=b1c998123313428f9ae7d427b6e26b9a, user.id=ec8bd792632b4ec2b0821d596ef6c2bc) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:51.579635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:51.581077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ec332-7b10-4fd7-b34c-355b51deecc5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:51.586702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 585/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:17:51 2022] GET /identity/v3/role_assignments?user.id=ec8bd792632b4ec2b0821d596ef6c2bc&scope.project.id=b1c998123313428f9ae7d427b6e26b9a&role.id=b5c3b136cc84423fb874b4d72253033e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:53.714921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faede40-fcd0-4b31-ac83-f5ce39b1f438 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:53.715453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faede40-fcd0-4b31-ac83-f5ce39b1f438 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:53.715453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faede40-fcd0-4b31-ac83-f5ce39b1f438 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:53.716860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 546/1131] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:53.722095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:53.722488 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:53.722653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:53.739559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:53.740784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:53.760711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:53.805495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 586/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:53.829343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faede40-fcd0-4b31-ac83-f5ce39b1f438 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:53.929868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faede40-fcd0-4b31-ac83-f5ce39b1f438 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:53.943233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:53.962056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:53.962830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:53.963107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:53.963377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:53.964540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:53.966014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe496-5d95-46d6-a6f5-9649902fe318 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:53.967555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 547/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:53.973927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:54.069305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9b67e-b595-42ec-bafd-547456324b58 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:54.102063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:54.102720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:54.103016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:54.103281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:54.103985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:54.105433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75600f73-fad4-4427-b88a-d6bbb8cdee9d None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:54.227948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 587/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:17:53 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:56.357532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5aa73-5943-4afc-9411-4f5101927298 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:56.358116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5aa73-5943-4afc-9411-4f5101927298 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:56.358116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5aa73-5943-4afc-9411-4f5101927298 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:56.359616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 548/1135] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:56.364844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:56.365268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:56.365407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:56.382331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:56.383521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:56.385711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:56.449339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 588/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:56.475118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5aa73-5943-4afc-9411-4f5101927298 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:56.574208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5aa73-5943-4afc-9411-4f5101927298 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:56.606084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:56.606874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:56.607152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:56.607429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:56.608658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:56.610882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734a1d-3d85-42a0-abb0-6341be96387b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:56.612468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 549/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:17:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:56.618196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:56.713641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d28d-a29d-4244-9514-ed55402c448c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:56.746384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:56.747055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:56.747337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:56.747614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:56.748363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:56.750567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d27d84-62f3-4439-b602-749934008ff9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:56.759092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:56.872371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 589/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:17:56 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:17:59.021809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795c1d-36a6-4db8-a37c-2763d5d16e35 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.022350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795c1d-36a6-4db8-a37c-2763d5d16e35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.022350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795c1d-36a6-4db8-a37c-2763d5d16e35 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.023711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 550/1139] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:17:59.028819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.029205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.029380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.048377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:17:59.049603 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:17:59.115563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 590/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:17:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:17:59.139502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795c1d-36a6-4db8-a37c-2763d5d16e35 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:59.190439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:59.239826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795c1d-36a6-4db8-a37c-2763d5d16e35 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:59.272507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:59.273309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.273589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.273857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.283508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:17:59.291097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:17:59.292257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:17:59.293242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 551/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:17:59.298529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:59.394440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1da79-b220-4fe4-9d3e-6ad5a123bd59 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:59.417382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:59.427642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:59.428310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.428619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.428898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.429645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:17:59.429950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:59.431397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:59.439669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 591/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:59.445664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:59.543341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca31b-b4e7-466f-a9bc-6b22414b0c24 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:59.553810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:59.576345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:59.577228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.577634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.577917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] PATH_INFO: `/v3/users/a7111ccef9f34fb9877494e78507e3da` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.590961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a7111ccef9f34fb9877494e78507e3da)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:59.592394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:59.594178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 552/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:17:59 2022] GET /identity/v3/users/a7111ccef9f34fb9877494e78507e3da => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:17:59.599819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:59.695893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e85d7b-b55e-488c-93f7-840cd55b6d43 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:17:59.727241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:17:59.727877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:17:59.728158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:17:59.728429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:17:59.780689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:17:59.793505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:17:59.794942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:17:59.888502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 592/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:17:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:17:59.895150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:17:59.990537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285fc6-1e69-4860-bd74-7531be13b1c5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:00.023477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:00.024326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:00.024636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:00.024914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] PATH_INFO: `/v3/projects/28a9e3a2da5340f6af843f1062229baf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:00.026068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] RBAC: Authorizing `identity:get_project(project_id=28a9e3a2da5340f6af843f1062229baf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:00.027498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c135ad-1970-4905-9c9b-b9bf6f061164 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:00.029280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 553/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:17:59 2022] GET /identity/v3/projects/28a9e3a2da5340f6af843f1062229baf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:00.035422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:00.117443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:00.132228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887c18-86e0-402e-be14-12621e04dbe7 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:00.165677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:00.166317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:00.166599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:00.166875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:00.167692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=28a9e3a2da5340f6af843f1062229baf, user.id=a7111ccef9f34fb9877494e78507e3da) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:00.168003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:00.169442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b13a2-9ff7-4f86-803c-403530a08a5b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:00.175430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 593/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:18:00 2022] GET /identity/v3/role_assignments?user.id=a7111ccef9f34fb9877494e78507e3da&scope.project.id=28a9e3a2da5340f6af843f1062229baf&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:02.254801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577995-0c3e-437b-9a90-cd04682c0dee None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.255323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577995-0c3e-437b-9a90-cd04682c0dee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.255323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577995-0c3e-437b-9a90-cd04682c0dee None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.256647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 554/1147] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:02.262100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.262486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.262663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.279705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:02.280985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:02.345512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 594/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:02.367838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2577995-0c3e-437b-9a90-cd04682c0dee None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:02.403348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:02.469449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2577995-0c3e-437b-9a90-cd04682c0dee None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:02.510094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:02.510810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.511089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.511359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.521139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:18:02.528718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:02.529808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:18:02.530870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 555/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:02.536153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:02.613466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:02.632192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef87e4-c798-489e-a95a-73045324ce14 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:02.665574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:02.666218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.666503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.666777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.667521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:02.667826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:02.669207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:02.677715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 595/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:02.683724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:02.779670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:02.785398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312fa1-a4af-4dc7-bff6-3d173d35bd84 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:02.818731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:02.819597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.819880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.820155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] PATH_INFO: `/v3/users/a7111ccef9f34fb9877494e78507e3da` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.821363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] RBAC: Authorizing `identity:get_user(user_id=a7111ccef9f34fb9877494e78507e3da)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:02.822795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:02.824431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 556/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:18:02 2022] GET /identity/v3/users/a7111ccef9f34fb9877494e78507e3da => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:02.830192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:02.926177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-b8a2-441b-b5a3-e4b3f1f961b6 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:02.959022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:02.959877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:02.960162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:02.960437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] PATH_INFO: `/v3/projects/28a9e3a2da5340f6af843f1062229baf` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:02.961638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] RBAC: Authorizing `identity:get_project(project_id=28a9e3a2da5340f6af843f1062229baf)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:02.963063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b4796-56ae-4a65-843e-7924c461749f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:02.964790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 596/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:18:02 2022] GET /identity/v3/projects/28a9e3a2da5340f6af843f1062229baf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:02.970906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:03.067036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a055ac-6b3f-4696-9c9e-cff25f74098d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:03.102508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:03.103382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:03.103663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:03.103935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] PATH_INFO: `/v3/projects/28a9e3a2da5340f6af843f1062229baf/users/a7111ccef9f34fb9877494e78507e3da/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:03.105925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=28a9e3a2da5340f6af843f1062229baf, user_id=a7111ccef9f34fb9877494e78507e3da, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:03.107353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f1091-bcc9-40f1-92c0-d3c694e26d6d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:03.230370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 557/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:18:02 2022] PUT /identity/v3/projects/28a9e3a2da5340f6af843f1062229baf/users/a7111ccef9f34fb9877494e78507e3da/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:18:05.326004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bea2-510a-43ec-bcb2-be3c09aaea35 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:05.326545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bea2-510a-43ec-bcb2-be3c09aaea35 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:05.326545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bea2-510a-43ec-bcb2-be3c09aaea35 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:05.327914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 597/1154] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:05.333403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:05.333815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:05.333963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:05.350911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:05.352151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:05.369569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:05.424457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 558/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:05.447481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4bea2-510a-43ec-bcb2-be3c09aaea35 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:05.459976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:05.546248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4bea2-510a-43ec-bcb2-be3c09aaea35 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:05.578663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:05.579365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:05.579644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:05.579914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:05.589749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:18:05.597535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:05.598612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:18:05.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 598/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:05.604688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:05.700815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd0fd-59bb-48c2-8e68-2a3118b0296b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:05.733168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:05.734422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:05.734704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:05.734981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:05.735728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:05.736037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:05.737420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:05.745200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 559/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:18:05.751583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:05.818936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:05.849146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce3aa-611d-426b-97e6-b7f90a4af689 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:05.881627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:05.882477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:05.882753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:05.883019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] PATH_INFO: `/v3/users/a7111ccef9f34fb9877494e78507e3da` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:05.884438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] RBAC: Authorizing `identity:get_user(user_id=a7111ccef9f34fb9877494e78507e3da)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:05.885886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:05.887486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 599/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:18:05 2022] GET /identity/v3/users/a7111ccef9f34fb9877494e78507e3da => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:05.893428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:05.912143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:05.991653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332068-0bc0-4815-b947-3c0676318687 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:06.024107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:06.024766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:06.025044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:06.025315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:06.090952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:06.092440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:06.109793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:06.188201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 560/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:18:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:18:06.194052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:06.291353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d1a7-ad40-4f17-8447-345ca1f87c56 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:06.324210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:06.325083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:06.325360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:06.325631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] PATH_INFO: `/v3/projects/28a9e3a2da5340f6af843f1062229baf` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:06.326777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] RBAC: Authorizing `identity:get_project(project_id=28a9e3a2da5340f6af843f1062229baf)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:06.328745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342c5fa-e802-4a95-998c-999ecc2a6a0b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:06.330410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 600/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:18:06 2022] GET /identity/v3/projects/28a9e3a2da5340f6af843f1062229baf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:06.336319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:06.432124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174289-a673-4d8a-9188-c7ad502ccdc5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:06.447905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:06.465052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:06.465692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:06.465974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:06.466249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:06.467079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=28a9e3a2da5340f6af843f1062229baf, user.id=a7111ccef9f34fb9877494e78507e3da) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:06.467392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:06.469034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15b8d-3a00-46a5-86fd-976a38135eec None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:06.474625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 561/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:18:06 2022] GET /identity/v3/role_assignments?user.id=a7111ccef9f34fb9877494e78507e3da&scope.project.id=28a9e3a2da5340f6af843f1062229baf&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:08.633931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c455-5b6b-421c-b839-11926ccf2f63 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:08.634480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c455-5b6b-421c-b839-11926ccf2f63 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:08.634480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c455-5b6b-421c-b839-11926ccf2f63 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:08.635849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 601/1162] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:08.641529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:08.641970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:08.642088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:08.659669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:08.660892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:08.725506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 562/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:08.747242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c455-5b6b-421c-b839-11926ccf2f63 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:08.757106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:08.848664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c455-5b6b-421c-b839-11926ccf2f63 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:08.881603 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:08.882236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:08.882515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:08.882786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:08.948033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:08.949515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:08.956899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:09.043166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 602/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:18:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:18:09.049587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:09.142998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeaf67-c7e2-4619-8164-027fdecf7871 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:09.153051 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:09.176124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:09.176879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:09.177162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:09.177433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:09.184156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:09.185622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e98ae64f-1a3b-4387-b76d-33e7e5f5214f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:09.199369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:09.204694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:18:09.205726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 563/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:18:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:09.206537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:09.301073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337c242-1ddc-4965-9a2e-0f221fc82259 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:09.308054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:09.333813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:09.334649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:09.335105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:09.335667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:09.336376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:09.336707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:09.338058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2bbc-4538-4fd4-810b-47e2cae03681 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:09.345699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 603/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 08:18:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:11.462862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b96b-972d-4bf6-a5f1-8046a42b3ec8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:11.463390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b96b-972d-4bf6-a5f1-8046a42b3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:11.463390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5b96b-972d-4bf6-a5f1-8046a42b3ec8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:11.464796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 564/1167] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:11.470620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b0e2-5716-4330-aa21-1b2b9bae8f5a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:11.471042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b0e2-5716-4330-aa21-1b2b9bae8f5a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:11.471148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b0e2-5716-4330-aa21-1b2b9bae8f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:11.492463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c2a0b0e2-5716-4330-aa21-1b2b9bae8f5a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:11.493696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c2a0b0e2-5716-4330-aa21-1b2b9bae8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:11.565229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 604/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:11.589095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5b96b-972d-4bf6-a5f1-8046a42b3ec8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:11.688175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5b96b-972d-4bf6-a5f1-8046a42b3ec8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:11.720974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:11.721555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:11.721838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:11.722113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:11.722859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:11.724226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3004854-654d-41d3-903c-5601283c5ec1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:11.821320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 565/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Fri Jun 17 08:18:11 2022] POST /identity/v3/domains => generated 267 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:18:13.949704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf4a0-28c8-4e9e-9a67-459d3d92ac50 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:13.950211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf4a0-28c8-4e9e-9a67-459d3d92ac50 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:13.950320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf4a0-28c8-4e9e-9a67-459d3d92ac50 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:13.951675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 605/1170] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:13.957182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:13.957598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:13.957742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:13.975032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:13.976204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:14.000058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:14.041564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 566/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:14.066336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf4a0-28c8-4e9e-9a67-459d3d92ac50 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:14.160700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:14.164289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf4a0-28c8-4e9e-9a67-459d3d92ac50 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:14.196933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:14.197779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:14.198058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:14.198332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] PATH_INFO: `/v3/domains/bd5d9900511246d8b2308eaefd78b6a4` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:14.208525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd5d9900511246d8b2308eaefd78b6a4)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:14.209957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848990-0255-414f-ba34-38db7470a904 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:14.211563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 606/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 17 08:18:14 2022] GET /identity/v3/domains/bd5d9900511246d8b2308eaefd78b6a4 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:14.217970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:14.313463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764ffdd-3fab-42f8-a2df-698ad50ab166 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:14.346035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:14.346679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:14.346963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:14.347239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:14.347955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:14.349420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae53e-0932-4d8c-affc-822207f340e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:14.432634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 567/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:18:14 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:18:16.578759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6141-6a89-4f24-b593-d5544a396038 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:16.579351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6141-6a89-4f24-b593-d5544a396038 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:16.579351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6141-6a89-4f24-b593-d5544a396038 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:16.580738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 607/1174] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:16.586031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:16.586439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:16.586584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:16.603475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:16.604677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:16.612507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:16.674378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 568/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:18:16.698933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d6141-6a89-4f24-b593-d5544a396038 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:16.798691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d6141-6a89-4f24-b593-d5544a396038 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:16.831499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:16.832365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:16.832675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:16.832955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] PATH_INFO: `/v3/domains/bd5d9900511246d8b2308eaefd78b6a4` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:16.834119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd5d9900511246d8b2308eaefd78b6a4)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:16.835539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a4cc-c06f-4d8b-9c6c-1cd319f583d1 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:16.837185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 608/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 17 08:18:16 2022] GET /identity/v3/domains/bd5d9900511246d8b2308eaefd78b6a4 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:16.844553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:16.950561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04600469-f94b-45fc-b69e-10d06f4a1572 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:16.983728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:16.984387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:16.984699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:16.984976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:16.985678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:16.987108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98f741-2ee0-4f75-acd1-68680805d613 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:17.078201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:17.084158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 569/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:18:16 2022] POST /identity/v3/users => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:18:19.288910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c19f-57c9-4512-a015-13e10bf25c23 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:19.289431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c19f-57c9-4512-a015-13e10bf25c23 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:19.289431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c19f-57c9-4512-a015-13e10bf25c23 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:19.290774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 609/1178] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:19.298327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:19.298921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:19.298921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:19.317604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:19.319134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:19.385512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 570/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:19.409226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472c19f-57c9-4512-a015-13e10bf25c23 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:19.437147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:19.509433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472c19f-57c9-4512-a015-13e10bf25c23 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:19.543375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:19.544076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:19.544356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:19.544658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:19.555306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:18:19.563132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:19.564267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:18:19.565189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 610/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:19.571447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:19.676256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f93f-1243-442e-9c56-f664467ab8fa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:19.705334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:19.713557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:19.744587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:19.745103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 571/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:19.745195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:19.818349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:19.830415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a79f-c07b-4492-91b8-31633cd53b0f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:19.864038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:19.864927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:19.865209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:19.865483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] PATH_INFO: `/v3/users/fef07ce989c243ae8272915a98b1ff85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:19.878065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] RBAC: Authorizing `identity:get_user(user_id=fef07ce989c243ae8272915a98b1ff85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:19.879538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:19.881195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 611/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:18:19 2022] GET /identity/v3/users/fef07ce989c243ae8272915a98b1ff85 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:19.887188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:19.985364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa923b3-e8bc-450b-b0b5-0bb85f6fd27a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:20.018374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:20.019010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:20.019293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:20.019570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:20.074189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:20.084559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:20.086007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:20.180177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 572/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:18:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:18:20.186613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:20.282318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f626d4-ff6c-47bd-aa80-e5a0fb360d2a None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:20.314528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:20.315367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:20.315644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:20.315916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] PATH_INFO: `/v3/projects/3995129fba6b46b084bccff3694f0a8e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:20.317095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] RBAC: Authorizing `identity:get_project(project_id=3995129fba6b46b084bccff3694f0a8e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:20.318523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffbaf9-8b9a-4165-8e37-9e1b0ece0e13 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:20.320246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 612/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:18:20 2022] GET /identity/v3/projects/3995129fba6b46b084bccff3694f0a8e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:20.326743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:20.413025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:20.422231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1ada-3baa-4d75-ad68-30881364afb8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:20.454909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:20.455552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:20.455836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:20.456112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:20.457041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=3995129fba6b46b084bccff3694f0a8e, user.id=fef07ce989c243ae8272915a98b1ff85) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:20.457558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:20.459503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e5e9c-27a1-48aa-b82b-2f8e520e9a58 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:20.464857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 573/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:18:20 2022] GET /identity/v3/role_assignments?user.id=fef07ce989c243ae8272915a98b1ff85&scope.project.id=3995129fba6b46b084bccff3694f0a8e&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:22.584028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125ba4-99a8-48a9-aeb8-f471daf086d3 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:22.584588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125ba4-99a8-48a9-aeb8-f471daf086d3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:22.584713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125ba4-99a8-48a9-aeb8-f471daf086d3 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:22.585967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 613/1186] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:18:22.591215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:22.592135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:22.592392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:22.609238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:22.610409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:22.674692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 574/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:22.696653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125ba4-99a8-48a9-aeb8-f471daf086d3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:22.711783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:22.816073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125ba4-99a8-48a9-aeb8-f471daf086d3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:22.849638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:22.850362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:22.850642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:22.850914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:22.860667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:18:22.868207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:22.869301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:18:22.870171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 614/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:22.875724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:22.959008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:22.974267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8055f6-8606-457f-b95a-075bc5217901 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:23.006639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:23.007291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:23.007572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:23.007844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:23.008865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:23.009167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:23.010526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:23.018795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 575/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:23.024515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:23.104303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:23.128299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9152b-b304-42af-9694-385b9e9807a3 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:23.161292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:23.162164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:23.162447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:23.162723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] PATH_INFO: `/v3/users/fef07ce989c243ae8272915a98b1ff85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:23.163907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] RBAC: Authorizing `identity:get_user(user_id=fef07ce989c243ae8272915a98b1ff85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:23.165367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:23.167000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 615/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:18:23 2022] GET /identity/v3/users/fef07ce989c243ae8272915a98b1ff85 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:23.172916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:23.270351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbf9-b8be-4660-8611-8ce526a0605b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:23.302029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:23.302872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:23.303152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:23.303427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] PATH_INFO: `/v3/projects/3995129fba6b46b084bccff3694f0a8e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:23.304617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] RBAC: Authorizing `identity:get_project(project_id=3995129fba6b46b084bccff3694f0a8e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:23.306046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6bd4e-eb00-4198-881b-5546669b7907 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:23.307706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 576/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:18:23 2022] GET /identity/v3/projects/3995129fba6b46b084bccff3694f0a8e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:23.314483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:23.415953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e242d-520e-47a0-877b-f49ced56a343 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:23.448561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:23.449443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:23.449725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:23.450002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] PATH_INFO: `/v3/projects/3995129fba6b46b084bccff3694f0a8e/users/fef07ce989c243ae8272915a98b1ff85/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:23.452548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] RBAC: Authorizing `identity:create_grant(project_id=3995129fba6b46b084bccff3694f0a8e, user_id=fef07ce989c243ae8272915a98b1ff85, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:23.453981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581bee2-94ae-421e-a5d8-cf01ffa831ae None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:23.553062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 616/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:18:23 2022] PUT /identity/v3/projects/3995129fba6b46b084bccff3694f0a8e/users/fef07ce989c243ae8272915a98b1ff85/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:18:25.671650 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5b8c-d736-46fb-ac74-19c95b75347f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:25.672200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5b8c-d736-46fb-ac74-19c95b75347f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:25.672200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5b8c-d736-46fb-ac74-19c95b75347f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:25.673612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 577/1193] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:18:25.678666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:25.679059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:25.679224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:25.684179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:25.695987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:18:25.697204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:18:25.760901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 617/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:18:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:18:25.785520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5b8c-d736-46fb-ac74-19c95b75347f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:25.801237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:25.882179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5b8c-d736-46fb-ac74-19c95b75347f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:25.916170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:25.917006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:25.917290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:25.917564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:25.927489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:18:25.935119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:18:25.936186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:18:25.937246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 578/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:18:25.942225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:26.043601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19875c-d8d4-4086-b929-ecc8652fd989 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:26.071417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:26.076809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:26.077480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:26.077763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:26.078038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:26.078819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:26.079127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:26.080510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:26.088375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 618/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:26.095556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:26.169817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:26.193808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33a3a-47e3-494f-938d-61c7b75fa6a3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:26.226741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:26.227594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:26.227884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:26.228160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] PATH_INFO: `/v3/users/fef07ce989c243ae8272915a98b1ff85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:26.229367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] RBAC: Authorizing `identity:get_user(user_id=fef07ce989c243ae8272915a98b1ff85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:26.230794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:26.232466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 579/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 08:18:26 2022] GET /identity/v3/users/fef07ce989c243ae8272915a98b1ff85 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:26.238579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:26.336396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8a1d-a4a1-4734-927e-a52be1669a1c None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:26.367903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:26.368577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:26.368863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:26.369141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:26.430579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:26.438265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:26.439768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:26.535436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 619/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:18:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:18:26.541251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:26.639667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65657-cd0d-48c8-8b7e-7cc77888643c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:26.672267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:26.673121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:26.673396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:26.673665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] PATH_INFO: `/v3/projects/3995129fba6b46b084bccff3694f0a8e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:26.674824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] RBAC: Authorizing `identity:get_project(project_id=3995129fba6b46b084bccff3694f0a8e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:26.676238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e812f-2d12-4219-a352-e1d82a486d95 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:26.677907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 580/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 08:18:26 2022] GET /identity/v3/projects/3995129fba6b46b084bccff3694f0a8e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:26.683775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:18:26.783129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:26.789294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4685fdc-aa67-49ab-98b7-162eab94d947 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:18:26.822755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:18:26.823396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:18:26.823676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:18:26.823949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:18:26.824802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=3995129fba6b46b084bccff3694f0a8e, user.id=fef07ce989c243ae8272915a98b1ff85) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:18:26.825111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:18:26.826768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642b66-c08e-427d-9b15-51e05a00fd22 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:18:26.832388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 620/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:18:26 2022] GET /identity/v3/role_assignments?user.id=fef07ce989c243ae8272915a98b1ff85&scope.project.id=3995129fba6b46b084bccff3694f0a8e&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:18:36.667249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:18:36.829815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=21 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:43.089154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0f56-16ed-47a3-a146-d407b451746a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:43.089738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0f56-16ed-47a3-a146-d407b451746a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:43.089738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0f56-16ed-47a3-a146-d407b451746a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:43.091075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 581/1201] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:19:43.096622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:43.097061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:43.097161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:43.113882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:19:43.115061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:19:43.182257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 621/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:19:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:19:43.207539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0f56-16ed-47a3-a146-d407b451746a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:43.307024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0f56-16ed-47a3-a146-d407b451746a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:43.340329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:43.341137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:43.341422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:43.341697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:43.351585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:43.353174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:43.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:43.371871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:43.372901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:43.372901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:43.372901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:43.372901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:43.372901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 582/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:43.377943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:43.476102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb24913-89e1-4311-8936-8c2062f45b23 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:43.505165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:43.511393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:43.512043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:43.512323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:43.512623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:43.513329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:43.513632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:43.514974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782737b-0e11-4f5b-ae80-6b99e2e1c6d3 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:43.528458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 622/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:43.534320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:43.587860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:43.633198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b036-590d-49ca-9864-483e2c51679d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:43.668978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:43.669677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:43.669958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:43.670231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:43.671032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:43.672782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737727e-5d5a-478f-8b39-5b81b88fd20b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:43.805220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 583/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 08:19:43 2022] POST /identity/v3/users => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:19:45.963834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a54c9-9b2c-4cb9-8ed2-f2a068c5a9c4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:45.964355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a54c9-9b2c-4cb9-8ed2-f2a068c5a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:45.964460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a54c9-9b2c-4cb9-8ed2-f2a068c5a9c4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:45.965846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 623/1206] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:19:45.970938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:45.971335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:45.971487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:45.988032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:19:45.989265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:19:46.062801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 584/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:19:46.086868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a54c9-9b2c-4cb9-8ed2-f2a068c5a9c4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.189688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a54c9-9b2c-4cb9-8ed2-f2a068c5a9c4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:46.222549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:46.223344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:46.223626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:46.223903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:46.234445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:19:46.242267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:46.248308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:46.249405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 624/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:46.250285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.288618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:46.346568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5854d0-3db3-47cb-a9f7-048313af0fb4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:46.379431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:46.380089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:46.380408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:46.380813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:46.381818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:46.382126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:46.383625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:46.391375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 585/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:46.397115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.453652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:46.501116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d0ae-4490-4198-9940-62ca3e05609b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:46.535649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:46.536444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:46.536756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:46.537029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:46.547334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:46.548813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:46.567756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:46.569009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:46.570213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:46.570213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:46.570213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:46.570213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:46.570213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 625/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:46.575232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.676976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:46.680709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2a8d-6845-4798-90be-c0e942d60f0b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:46.713236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:46.713831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:46.714111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:46.714386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:46.715100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:46.715460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:46.716878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:46.728546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 586/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:46.734177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.833087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51d6b-6d61-49fd-a60d-3ddf1f54b158 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:46.834583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:46.867175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:46.868141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:46.868425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:46.868726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:46.875505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:46.877001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:19:46.892342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:46.893714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:46.894672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 626/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:46.899997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:46.999665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a48d-670d-411b-9f0c-10872f7d856c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.032723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.033373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.033652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.033918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.034747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:47.035047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.036458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:47.055239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 587/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:19:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:47.061097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:47.158734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff4eb0-798a-48d6-a03d-8dcfc666b910 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.192170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.192845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.193126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.193423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.223306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:47.260150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.261573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:47.354236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 627/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:19:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:19:47.360059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:47.378544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:47.455733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6a151-a7f3-4fa7-8d20-860708b469b1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.489236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.490032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.490310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.490619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.500821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.502252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:47.520703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:47.521741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:47.522886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:47.522886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:47.522886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:47.522886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:47.522886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 588/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:47.528194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:47.589695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:47.628102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeeace-ab0c-4a56-ba9b-051f5e36c802 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.662289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.662955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.663238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.663517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.664284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:47.664622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.665996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:47.677451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 628/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:47.683810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:47.752576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:47.782720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19130756-a54a-4dfd-b8dd-b2e19321e428 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.814547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.815363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.815862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.816367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.824202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.825719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:19:47.839925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:47.841021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:47.842102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 589/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:47.847053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:47.952288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5232e-fcff-49fc-964b-8e291ec4803f None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:47.976256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:47.987859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:47.988565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:47.988850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:47.989132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:47.990034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:47.990348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:47.992206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62945640-3520-40e3-bde2-5559ee902ed2 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:48.003252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 629/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:48.010233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:48.114537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc470-8b0d-4cfc-80ea-1e25b8bd44e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:48.143378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:48.149611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:48.150257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:48.150535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:48.150802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:48.151621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=b199ab9b81fd4bfa8f2282e45971a269) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:48.152008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:48.153459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7efbbb-d3dd-46aa-98fb-058cb6fe4557 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:48.158711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 590/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:19:48 2022] GET /identity/v3/role_assignments?user.id=b199ab9b81fd4bfa8f2282e45971a269&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:50.282782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c698fe-4e85-49ae-82e9-6d6b6b029553 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:50.283297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c698fe-4e85-49ae-82e9-6d6b6b029553 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:50.283297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c698fe-4e85-49ae-82e9-6d6b6b029553 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:50.284665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 630/1220] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:19:50.289844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:50.290220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:50.290399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:50.306780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:19:50.307961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:19:50.376064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 591/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:19:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:19:50.400755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c698fe-4e85-49ae-82e9-6d6b6b029553 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:50.500551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c698fe-4e85-49ae-82e9-6d6b6b029553 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:50.534350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:50.535075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:50.535353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:50.535626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:50.545598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:19:50.553288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:50.554735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:50.555570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 631/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:50.561576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:50.658168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d227d-5d2f-4984-9ca0-fe9356012ce0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:50.681766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:50.691878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:50.692557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:50.692837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:50.693108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:50.693846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:50.694174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:50.696649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:50.704190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 592/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:50.709896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:50.755744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:50.813471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652539dd-1583-4d2a-b3e2-fa200d574757 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:50.846503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:50.847297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:50.847580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:50.847854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:50.858487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:50.860010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:50.877500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:50.878544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:50.879632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:50.879632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:50.879632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:50.879632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:50.879632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 632/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:50.886200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:50.987429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e1b-33f5-4d54-b2f1-a1df3c9b7162 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.020189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.020873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.021157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.021432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.022146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:51.022451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.023866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.035291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 593/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:51.041808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.140237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:51.147106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ffc39-1677-4990-8274-b62dae456e20 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.181860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.182667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.182937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.183318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.190279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.191748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:19:51.206364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:51.207419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:51.208383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 633/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:51.213675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.260864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:51.312897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb2ed-15ba-49b7-8ece-f6a5f9cc2ef7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.345768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.346424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.346704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.346973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.347796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:51.348099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.349625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.369088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 594/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:51.374883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.480765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d24ea-dd14-47ee-94d8-bdbe2d4739eb None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.516410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.517305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.517585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.539044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.539044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.539044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:51.547383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:51.548398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:51.549385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:51.549385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:51.549385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:51.549385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:51.549385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 634/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:51.554420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.654081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd3eff-bbfa-4955-a30e-9240056da51e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.656351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:51.689681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.690630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.691048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.691459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.692610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:51.693074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.695720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.709992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 595/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:51.717030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.727919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:51.817703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0514b-1d8d-4c95-8298-2bf6fb7a7809 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:51.849665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:51.850458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:51.850741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:51.851505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:51.858065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:51.859487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:19:51.873971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:51.875062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:51.876283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 635/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:19:51.881364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:51.979994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1f12-28b0-4b80-93bb-c96601c426fc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:52.013581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:52.014229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:52.014504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:52.014774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:52.015547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:52.015852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:52.017284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4e6b5-38cc-4b00-8a9f-e6de86dfe340 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:52.030393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 596/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:52.036373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:52.104335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:52.143768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a1a7-8e46-4791-865b-fbdbe3fd7c3b None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:52.177078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:52.177963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:52.178247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:52.178523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/b199ab9b81fd4bfa8f2282e45971a269/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:52.192442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=b199ab9b81fd4bfa8f2282e45971a269, role_id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:52.203399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caaa67-80a3-4b8f-b819-657f42e6b9dd None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:52.451028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 636/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:19:52 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/b199ab9b81fd4bfa8f2282e45971a269/roles/c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:19:54.558063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f8c6-c89b-4056-a166-a8d5dde26078 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:54.558604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f8c6-c89b-4056-a166-a8d5dde26078 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:54.558604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f8c6-c89b-4056-a166-a8d5dde26078 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:54.559996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 597/1233] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:19:54.565109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:54.565526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:54.565657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:54.582986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:19:54.584162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:19:54.650871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 637/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:19:54.675035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f8c6-c89b-4056-a166-a8d5dde26078 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:54.701032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:54.778410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f8c6-c89b-4056-a166-a8d5dde26078 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:54.813072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:54.813796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:54.814067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:54.814383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:54.824459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:19:54.832148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:54.833288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:54.834510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 598/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 08:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:54.839468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:54.884951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:54.936252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa84e-3b8e-47d3-bbe0-6fedf224b71d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:54.968574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:54.969245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:54.969530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:54.969808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:54.970550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:54.970855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:54.972231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:54.980454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 638/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 08:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:54.986275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.070125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:55.085581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd431b-1a16-446b-ba15-5519141b8698 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:55.121319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:55.122165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:55.122454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:55.122728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:55.133254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:55.134702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:55.152276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:55.153363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:55.154278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:55.154278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:55.154278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:55.154278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:55.154278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 599/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:55.159467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.258921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d230c-3e02-48f3-b9f3-042d5c8697b8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:55.267620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:55.292253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:55.293567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:55.293567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:55.293567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:55.294363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:55.294675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:55.296037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:55.307706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 639/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:55.313610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.412497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a32ce-4b92-49c0-acb9-6a3eacd3f20d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:55.446234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:55.447098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:55.447381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:55.447657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:55.450334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:55.463840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:55.465362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:19:55.480827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:55.482070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:55.483173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 600/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:55.488083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.585630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b589f5-ca4f-4f2c-9314-5ed9b1bc80ed None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:55.618425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:55.619090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:55.619370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:55.619645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:55.620472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:55.620809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:55.622227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:55.639684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 640/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:55.648063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.745608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822860a-534c-4c82-bbe8-db662e403c04 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:55.781562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:55.782207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:55.782486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:55.782755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:55.842889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:55.849346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:55.850806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:55.949196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 601/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:19:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:19:55.955112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:55.982631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:56.054883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dedcc-4683-4bca-8cce-387cf9d7c477 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:56.087824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:56.088647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:56.088932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:56.089207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:56.099592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:56.101121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:56.119426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:56.120596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:56.121892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:56.121892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:56.121892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:56.121892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:56.121892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 641/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:56.126263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:56.220505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:56.226796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea4b91-eb8d-4c72-a805-bd2e7343ee0e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:56.259662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:56.260316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:56.260625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:56.260900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:56.261620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:56.261947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:56.263301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:56.274091 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 602/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:56.279940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:56.357025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:56.377655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590090ca-3d71-4321-b275-1ebf6b84e996 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:56.409898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:56.410688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:56.410971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:56.411245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:56.418335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:56.419834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:19:56.433819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:56.437010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:19:56.438103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 642/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:56.441352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:56.540179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d31449-9c2f-4b6a-8a2d-766fe4b88f61 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:56.573229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:56.573874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:56.574154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:56.574422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:56.575191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:56.575495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:56.576940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae643ba5-6186-443a-99f6-62841fd1ab3d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:56.589479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 603/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:56.595622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:56.695864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f34d8-eaa6-4731-b260-be24b4d20abb None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:56.729338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:56.730002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:56.730283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:56.730557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:56.731376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] RBAC: Adding query filter params (role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=b199ab9b81fd4bfa8f2282e45971a269) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:56.731685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:56.733148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736a5a-1d5c-4732-9074-4083f3113a00 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:56.738815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 643/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:19:56 2022] GET /identity/v3/role_assignments?user.id=b199ab9b81fd4bfa8f2282e45971a269&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=c7d6b8ae61c74eb1b1b9d1d8e0a11f76 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:58.915215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4aad-a71b-4a75-8815-666aa984efcf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:58.915665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4aad-a71b-4a75-8815-666aa984efcf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:58.915771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4aad-a71b-4a75-8815-666aa984efcf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:58.917184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 604/1247] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:19:58.922330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:58.922779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:58.922905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:58.927874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:58.941694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:19:58.942918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:19:59.009223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 644/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:19:59.032817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4aad-a71b-4a75-8815-666aa984efcf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.050883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:59.133241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4aad-a71b-4a75-8815-666aa984efcf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:59.167140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:59.167867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:59.168143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:59.168412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:59.178077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:19:59.189189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:59.190424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:59.191554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 605/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:59.196376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.292369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e906a-184d-4947-9280-b7836a8f864d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:59.320867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:59.325685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:59.326354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:59.326651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:59.326917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:59.327660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:59.327968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:59.329363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:59.337196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 645/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:59.343218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.436067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:59.464383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928caf91-b5e6-41e6-9053-0a4b2fdc3653 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:59.497623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:59.498407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:59.498692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:59.498964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:59.509534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:59.510982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:19:59.528475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:59.529569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:59.530647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:19:59.530647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:19:59.530647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:19:59.530647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:59.530647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 606/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:59.535628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.635783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c352-8372-4eb6-b06e-0a7f3462c3e5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:59.669263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:59.669965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:59.670245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:59.670521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:59.671230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:19:59.671533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:59.672927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:59.686139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 646/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:19:59.691862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.802653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef43fd-e716-49cd-baa2-881a6d65305b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:19:59.827988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:59.836023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:19:59.837110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:19:59.837110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:19:59.837377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:19:59.844530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:19:59.845965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:19:59.860355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:19:59.861529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:19:59.862898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 607/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:19:59.867492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:19:59.924433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:19:59.967560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df33c1-daee-44a1-aec3-3a5080c73dee None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.000246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.000948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.001230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.001505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.002328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:00.002659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.004105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.021354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 647/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:00.027819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:00.128603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248333-a7e1-4fec-a053-c1934d8dce80 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.161964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.162607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.162929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.163204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.224908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:00.236740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.238200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.331974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 608/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:20:00.338042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:00.435660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761e40-b4e1-45b3-8e1b-c9556a5c04ab None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.449441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:00.469568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.470365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.470649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.470926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.480933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.482318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:20:00.500074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:00.501131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:00.502210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:20:00.502210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:20:00.502210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:00.502210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:00.502210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 648/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:00.507963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:00.590843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:00.602489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cc771-b36d-4b3b-9c83-3c021f76c588 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.637515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.638168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.638450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.638736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.639491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:00.639937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.641334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.652882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 609/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:00.658472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:00.758849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb98e25-78a5-4bf5-a6ff-36a649c60cd4 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.791936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.792749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.793035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.793310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.799945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.801432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:20:00.815516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:00.816697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:00.817782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 649/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:00.822952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:00.920732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196acd-aaae-4347-8af3-3ea397fd0fa3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:00.953304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:00.958642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf50b6-f928-404e-8fd9-d9581ea17a67 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:00.968694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 610/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:00.974805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:01.001262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:01.073382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30653e94-7037-45d6-bfb1-fd25b299dd98 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:01.105988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:01.106631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:01.106915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:01.107192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:01.108015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=b199ab9b81fd4bfa8f2282e45971a269) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:01.108328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:01.109882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303b2d-b0fa-46eb-8df8-0cb2f09ca36f None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:01.116207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 650/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:20:00 2022] GET /identity/v3/role_assignments?user.id=b199ab9b81fd4bfa8f2282e45971a269&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:03.229447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2b07-1cc6-4dc5-8736-be5208982e55 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.229949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2b07-1cc6-4dc5-8736-be5208982e55 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.229949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2b07-1cc6-4dc5-8736-be5208982e55 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.231280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 611/1261] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:03.236574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.236993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.237128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.254351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:03.255527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:03.322694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 651/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:20:03.345492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e2b07-1cc6-4dc5-8736-be5208982e55 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:03.356437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:03.446207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e2b07-1cc6-4dc5-8736-be5208982e55 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:03.479682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:03.480415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.480730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.481009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.491373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:20:03.499000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:03.500069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:03.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 612/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:03.507480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:03.525691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:03.603670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b25565-9c93-4514-b1ed-c17ffcfd9f27 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:03.636384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:03.637080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.637362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.637639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.638382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:03.638688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:03.640081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:03.648768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 652/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:03.654655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:03.721165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:03.753471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d59ac-25d4-4443-90d2-5035b8b84ef7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:03.785958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:03.786737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.787021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.787297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.797807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:03.799250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:20:03.816163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:03.817252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:03.818184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:20:03.818184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:20:03.818184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:03.818184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:03.818184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 613/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:03.823912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:03.903824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:03.922664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063457-3001-4355-9f2d-b25aa5956db9 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:03.956290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:03.956991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:03.957264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:03.957541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:03.958255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:03.958559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:03.960543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:03.971836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 653/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:03.978608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.077127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b098a4b-bc36-44ea-9de7-59fe00fc81b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.096398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:04.110282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.111072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.111349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.111620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.119682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.121346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:20:04.136810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:04.137908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:04.139081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 614/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:04.143872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.248913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5adfd-bf38-4582-b1c8-c046ff182c12 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.282175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.282847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.283132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.283409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.284239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:04.284575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.286002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.295068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:04.304037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 654/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:20:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:20:04.309858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.407933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e96a-a2f8-4e39-abcf-883df8fc5d0e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.441094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.441882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.442167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.442445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.452893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.454341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:20:04.471209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:04.472259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:04.473211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:20:04.473211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:20:04.473211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:04.473211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:04.476631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 615/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:04.478824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.581050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381229a-fe19-47d9-9a20-5270221bc822 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.613924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.618832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.629045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 655/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:04.635670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.667216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:04.733416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b7df-34a9-4ba1-83e3-b2b343535058 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.768367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.769176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.769457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.769728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.777102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.778534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:20:04.792801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:04.793870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:04.794963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 616/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:04.799975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:04.858134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:04.900179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5349-3a11-4f88-85ca-20765440b0a5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:04.934953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:04.935552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:04.935832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:04.936106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:04.936916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:04.937224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:04.938639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c05231-9aeb-4251-bbae-9727a9a4f178 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:04.950657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 656/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:04.956820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:05.048455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:05.057213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dfedd-1f1f-4b25-b829-e74fe3219c04 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:05.090340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:05.091219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:05.091576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:05.091852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] PATH_INFO: `/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/b199ab9b81fd4bfa8f2282e45971a269/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:05.093820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2d6777e3d4fcfa13e43935c1f2d61, user_id=b199ab9b81fd4bfa8f2282e45971a269, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:05.095250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff8f85-8bad-4eeb-80d4-bb684feddc10 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:05.244319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 617/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 08:20:04 2022] PUT /identity/v3/projects/b7f2d6777e3d4fcfa13e43935c1f2d61/users/b199ab9b81fd4bfa8f2282e45971a269/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:20:07.369843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ae40-aece-4e7e-89a3-673e7777753b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:07.370405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ae40-aece-4e7e-89a3-673e7777753b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:07.370405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ae40-aece-4e7e-89a3-673e7777753b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:07.371761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 657/1274] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:07.377199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:07.377620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:07.377730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:07.395299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:07.396476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:07.462500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 618/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:20:07.489401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ae40-aece-4e7e-89a3-673e7777753b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:07.589395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ae40-aece-4e7e-89a3-673e7777753b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:07.606402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:07.622974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:07.623705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:07.623989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:07.624269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:07.634411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:20:07.642026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:07.643117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:07.644035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 658/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 08:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:07.649954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:07.729709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:07.748618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061edd-4bb7-4e28-9f30-a5b062ceedd5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:07.782252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:07.782931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:07.783200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:07.783473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:07.784221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:07.784552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:07.785916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:07.795216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 619/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 08:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:07.801074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:07.899463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd899-5914-4d1a-b2c4-52440005ad37 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:07.936016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:07.936838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:07.937121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:07.937395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:07.948179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:07.949830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:20:07.967469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:07.969452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:07.970594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:20:07.970594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:20:07.970594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:07.970594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:07.970594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 659/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:07.974768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:08.074356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cad68-f890-4ccb-b0be-69e2a75f6e0d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:08.107270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:08.107924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:08.108209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:08.108481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:08.109226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:08.109531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:08.110890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:08.122600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 620/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:08.128440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:08.159643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:08.227646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21c57-082a-4c19-a4e5-bb3117b8b3bb None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:08.262714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:08.263510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:08.263788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:08.264062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:08.271239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:08.273857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:20:08.289140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:08.290274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:08.291452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 660/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:08.296719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:08.300561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:08.395124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227ea-8931-4630-af16-2258f563f4ce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:08.428602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:08.429204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:08.429483 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:08.429753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:08.430574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:08.430882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:08.432293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:08.449481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 621/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 08:20:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:08.455442 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:08.545805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:08.555513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddc79a-f912-49a6-8324-703c55434576 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:08.591208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:08.591868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:08.592149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:08.592425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:08.658939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:08.660393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:08.746364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:08.757011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 661/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 08:20:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:20:08.762850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:08.822779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:08.859675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e0d-aba4-4470-9109-2b3fe9c39f0f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:08.892870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:08.893648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:08.893924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:08.894192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:08.905091 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:08.906583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:20:08.923869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:08.924918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:08.925953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:20:08.925953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:20:08.925953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:20:08.925953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:08.925953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 622/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:08.931290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:09.030349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040cabf-5564-45b8-b448-a1881af3b4e4 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:09.063554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:09.064216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:09.064516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:09.064817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:09.065536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:09.065843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:09.067208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:09.078112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 662/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:09.083800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:09.183820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b0d7-bfc7-4daa-bdb5-7044a56dcb1d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:09.196945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:09.215873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:09.216688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:09.216974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:09.217243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:09.223555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:09.225577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:20:09.239312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:09.240906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 17 08:20:09.242193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 623/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 08:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:09.246922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:09.296174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:09.344697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893148-c54b-44e4-b997-b3c492146d53 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:09.377104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:09.377761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:09.378048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:09.378329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:09.379108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:09.379415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:09.381145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde33b-3ffd-4ea3-8617-a3cb7069c6a4 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:09.392918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 663/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 08:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:09.399986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:09.508290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098139a-af87-498e-add7-806bbebbdb7a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:09.542234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:09.542871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:09.543145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:09.543412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:09.544227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] RBAC: Adding query filter params (role.id=e04cfa9b57ea4aafa95819fe6399b453, scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61, user.id=b199ab9b81fd4bfa8f2282e45971a269) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:09.544558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:09.545975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd3c1-06d9-4164-8ffd-df11391f4a86 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:09.551730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 624/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 08:20:09 2022] GET /identity/v3/role_assignments?user.id=b199ab9b81fd4bfa8f2282e45971a269&scope.project.id=b7f2d6777e3d4fcfa13e43935c1f2d61&role.id=e04cfa9b57ea4aafa95819fe6399b453 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:11.750126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3d0a-1849-405e-9d82-3a2e4a5a510c None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:11.750676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3d0a-1849-405e-9d82-3a2e4a5a510c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:11.750768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3d0a-1849-405e-9d82-3a2e4a5a510c None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:11.752098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 664/1288] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:11.758223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:11.758682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:11.779814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:11.779814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:11.779814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:11.806109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:11.842500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 625/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:20:11.864837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3d0a-1849-405e-9d82-3a2e4a5a510c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:11.968451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3d0a-1849-405e-9d82-3a2e4a5a510c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:11.979908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:12.003558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:12.004278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:12.004591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:12.004868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:12.005509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:12.007637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:12.019255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:12.020466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:12.021521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 665/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:20:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:12.027104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:12.123567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2edd0-c15d-449d-bfa4-c58219d10038 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:12.156919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:12.157574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:12.157853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:12.158125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:12.158824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:12.159124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:12.160515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb94894-965e-4f9f-93ee-a9a81a033143 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:12.166204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 626/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 08:20:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:12.172076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:12.272915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f09f-f379-4a4e-8ae4-067a972d3619 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:12.306860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:12.307518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:12.307793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:12.308061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] PATH_INFO: `/v3/services` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:12.308787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:12.309088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:12.310443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea6eb-7771-4b26-acf3-852eb3b245e8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:12.314735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 666/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 08:20:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:14.437580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5e12-7ee7-4b03-b1fe-ada5d2833714 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:14.438173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5e12-7ee7-4b03-b1fe-ada5d2833714 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:14.438173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5e12-7ee7-4b03-b1fe-ada5d2833714 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:14.439573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 627/1293] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:14.445166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1f2a-15df-4951-afe1-1a31425f585d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:14.445571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1f2a-15df-4951-afe1-1a31425f585d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:14.445746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1f2a-15df-4951-afe1-1a31425f585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:14.462770 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1fde1f2a-15df-4951-afe1-1a31425f585d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:14.464002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1fde1f2a-15df-4951-afe1-1a31425f585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:14.492759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:14.529963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 667/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:20:14.553187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b5e12-7ee7-4b03-b1fe-ada5d2833714 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:14.584283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:14.653635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b5e12-7ee7-4b03-b1fe-ada5d2833714 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:14.686786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:14.687442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:14.687815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:14.688048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:14.688802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:14.690163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41641-0864-45b8-94b2-35898955b4d7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:14.753103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 628/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 08:20:14 2022] POST /identity/v3/services => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:20:16.902978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e388-e47e-44ad-9333-fffd85f17c8b None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:16.903571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e388-e47e-44ad-9333-fffd85f17c8b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:16.903571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e388-e47e-44ad-9333-fffd85f17c8b None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:16.904954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 668/1296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:16.910082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:16.910498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:16.910632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:16.927714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:16.928900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:17.007380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 629/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:20:17.030671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7e388-e47e-44ad-9333-fffd85f17c8b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:17.129912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7e388-e47e-44ad-9333-fffd85f17c8b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:17.164240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:17.165145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:17.169314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:17.169314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:17.169314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:17.169314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:17.180126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:17.181318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:17.182179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 669/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:20:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:17.187374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:17.205960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:17.284536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be4ce-ef52-454a-be58-74c4ae0b45eb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:17.316195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:17.316894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:17.317181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:17.317455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:17.318762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:17.319065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:17.320435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:17.325453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 630/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 08:20:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:17.331330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:17.362221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:17.427626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4801-81d7-459f-b042-aedc7b0d7fc5 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:17.461227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:17.461882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:17.462166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:17.462443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:17.463225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] RBAC: Adding query filter params (interface=public, service_id=6f74f4f94dd14d8d8c59bd977790367a, region_id=RegionOne) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:17.463537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:17.464932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bce77-add2-45e8-8fd0-a4ebae9d77d8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:17.469824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 670/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 08:20:17 2022] GET /identity/v3/endpoints?service_id=6f74f4f94dd14d8d8c59bd977790367a&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:17.475569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:17.555027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:17.573077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2389-0baa-4ffe-9015-8c4b9e984745 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:17.605276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:17.605937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:17.606224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:17.606502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:17.607186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:17.608578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f75d7-3a7b-4b8f-a471-6aecf33dd783 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:17.615912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 631/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 08:20:17 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:20:19.748640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896ff86-f541-4dba-b94a-bc685e2b1b33 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:19.749211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896ff86-f541-4dba-b94a-bc685e2b1b33 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:19.749211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896ff86-f541-4dba-b94a-bc685e2b1b33 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:19.750566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 671/1302] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:20:19.756299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:19.759601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:19.759601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:19.773830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:20:19.774997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:20:19.840244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 632/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:20:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:20:19.863843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896ff86-f541-4dba-b94a-bc685e2b1b33 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:19.957960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:19.965178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896ff86-f541-4dba-b94a-bc685e2b1b33 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:19.997725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:19.998520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:19.998849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:19.999079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:19.999721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:20.001158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:20:20.013279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:20:20.014473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application with Lock( Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: ERROR keystone.server.flask.application Jun 17 08:20:20.015515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 672/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 08:20:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:20:20.020508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:20.096465 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:20.119547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ad759-ce97-43ff-9fb6-336bd1e0c343 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:20.152348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:20.153024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:20.153306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:20.153578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:20.154282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:20:20.154585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:20.155944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79787-fc4e-4004-974f-fbe9c8a5afb5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:20.161996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 633/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 08:20:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:20:20.167891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:20:20.268255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6514a8c-e6b2-4467-aa13-61eb3933fda8 None admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:20:20.339206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:20:20.339206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:20:20.339206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:20:20.339206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:20:20.339630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:20:20.339630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a0e32-57b8-49b3-bdbe-b833fc758f62 None admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:20:20.415308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 673/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 08:20:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:20:30.186898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=30 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:20:30.410483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:12.026565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717c8a-f3b5-4dc6-a3bc-8911e0c04b74 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:12.027129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717c8a-f3b5-4dc6-a3bc-8911e0c04b74 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:12.027367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717c8a-f3b5-4dc6-a3bc-8911e0c04b74 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:12.030209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 634/1307] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:12.035591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c62ca-97ad-44f9-ae2f-03c3dff76190 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:12.036031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c62ca-97ad-44f9-ae2f-03c3dff76190 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:12.036152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c62ca-97ad-44f9-ae2f-03c3dff76190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:12.204065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ec4c62ca-97ad-44f9-ae2f-03c3dff76190 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:12.208036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ec4c62ca-97ad-44f9-ae2f-03c3dff76190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:12.476218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 674/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:12.543028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:12.543904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:12.544982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:12.546767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 635/1309] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 17 08:27:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:12.553885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfe6de-c92d-4919-8883-40fb860c03c9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:12.554408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfe6de-c92d-4919-8883-40fb860c03c9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:12.554826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfe6de-c92d-4919-8883-40fb860c03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:12.662128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-47cfe6de-c92d-4919-8883-40fb860c03c9 None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:12.664202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-47cfe6de-c92d-4919-8883-40fb860c03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:12.689821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:12.763900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 675/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:12.764831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:12.766778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:12.909530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf19a-e195-498a-b31c-673f16ea7336 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:12.994175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:12.994747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:12.995030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:12.995306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:12.997422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:13.057195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:13.139602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:13.141115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd8f49-9563-4cc3-9877-ba1889880f21 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:13.164420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 636/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:27:15.676846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:15.677417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:15.677513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:15.678845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 676/1312] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:15.684088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefa30-034a-4685-86f5-96025d8bc091 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:15.684534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefa30-034a-4685-86f5-96025d8bc091 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:15.684815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefa30-034a-4685-86f5-96025d8bc091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:15.766734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-beeefa30-034a-4685-86f5-96025d8bc091 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:15.767939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-beeefa30-034a-4685-86f5-96025d8bc091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:15.866101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 637/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:15.906747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:15.908355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:16.015679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a1a7-dbfd-468b-bdad-0cc296327984 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:16.091777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:16.094478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:16.095181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:16.095468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:16.095749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:16.097462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:16.217601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:16.219068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804c37-3245-46cf-bbb3-38f15c3fa410 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:16.240987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 677/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:18.970001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:18.970550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:18.970550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:18.971893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 638/1315] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:18.976940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595b1f-c9cd-4b37-80b3-81226db15604 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:18.977325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595b1f-c9cd-4b37-80b3-81226db15604 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:18.977490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595b1f-c9cd-4b37-80b3-81226db15604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:19.042501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e5595b1f-c9cd-4b37-80b3-81226db15604 None None] MFA Rules not processed for user `9bb8cdd31f274fcfb5a0da55b7e0d32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:19.043852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e5595b1f-c9cd-4b37-80b3-81226db15604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:19.095725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:19.143344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 678/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:19.189437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:19.190964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:19.200571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:19.291894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51eca2-5a3b-4f62-9b77-9c2f61091309 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:19.371959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:19.372619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:19.372899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:19.373171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:19.374793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:19.435699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:19.484990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:19.486450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ae49a-78bd-42c4-b80e-69f825e533d6 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:19.505336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 639/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:22.525778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:22.526312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:22.526312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:22.527842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 679/1318] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:22.532968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca187c6-2e1a-4b20-a66b-51ed26ae5ef0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:22.533359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca187c6-2e1a-4b20-a66b-51ed26ae5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:22.533521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca187c6-2e1a-4b20-a66b-51ed26ae5ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:22.597480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3ca187c6-2e1a-4b20-a66b-51ed26ae5ef0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:22.598670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3ca187c6-2e1a-4b20-a66b-51ed26ae5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:22.691204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 640/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:22.729642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:22.731233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:22.832544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273595b-4b57-4947-b519-9768a9076b89 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:22.905498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:22.906574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:22.906574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:22.906746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:22.908296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:22.915282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:23.017315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:23.018747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e675b3a-1e2c-4b10-aa02-cfc8f16b803f service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:23.037616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 680/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:26.244243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b77-b313-488a-afec-602931528d0c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:26.244780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b77-b313-488a-afec-602931528d0c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:26.244780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b77-b313-488a-afec-602931528d0c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:26.246660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 641/1321] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:26.251909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0084ac-ebfc-4cfe-9f7b-283731c0997a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:26.252314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0084ac-ebfc-4cfe-9f7b-283731c0997a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:26.252612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0084ac-ebfc-4cfe-9f7b-283731c0997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:26.323456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ce0084ac-ebfc-4cfe-9f7b-283731c0997a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:26.325508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ce0084ac-ebfc-4cfe-9f7b-283731c0997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:26.384032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:26.429592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 681/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:26.465616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42659b77-b313-488a-afec-602931528d0c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:26.467154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-42659b77-b313-488a-afec-602931528d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:26.487949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:26.578839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42659b77-b313-488a-afec-602931528d0c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:26.651640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:26.653151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:26.653439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:26.653712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:26.655363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:26.724464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:26.764197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:26.765674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24a753-0093-4282-8b41-a241586ab8a9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:26.784290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 642/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:29.088720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:29.089861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:29.089958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:29.091464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 682/1324] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:29.096654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6e49-cfcf-42ca-beb7-d87edca74dce None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:29.097086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6e49-cfcf-42ca-beb7-d87edca74dce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:29.097231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6e49-cfcf-42ca-beb7-d87edca74dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:29.163612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fe4d6e49-cfcf-42ca-beb7-d87edca74dce None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:29.164759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe4d6e49-cfcf-42ca-beb7-d87edca74dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:29.264062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 643/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:29.299983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:29.301538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:29.408404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daacb7-6fee-468a-a70a-6b46014472d0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:29.483313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:29.483887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:29.484169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:29.484441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:29.486128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:29.503609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:29.604895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:29.606341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e445-f5bc-4abd-bc7b-3621fc91421a service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:29.624944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 683/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:31.822634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:31.823719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:31.823719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:31.825648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 644/1327] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:31.831055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a45b9-9237-4b32-9bb6-54c9216383b9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:31.831470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a45b9-9237-4b32-9bb6-54c9216383b9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:31.831620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a45b9-9237-4b32-9bb6-54c9216383b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:31.896468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ab8a45b9-9237-4b32-9bb6-54c9216383b9 None None] MFA Rules not processed for user `9bb8cdd31f274fcfb5a0da55b7e0d32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:31.897734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ab8a45b9-9237-4b32-9bb6-54c9216383b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:31.965672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:31.999815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 684/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:32.037777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:32.039299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:32.069907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:32.168671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc2de-090d-407c-8770-dca34a3f5dc0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:32.246936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:32.247588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:32.247871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:32.248147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:32.249827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:32.335454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:32.371487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:32.372947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f981fe-aee1-4792-a4f4-7db9ba7c8ef7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:32.391915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 645/1329] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:34.982781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eead4f-5978-43e6-bf79-a1bf024460ff None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:34.983341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eead4f-5978-43e6-bf79-a1bf024460ff None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:34.983341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eead4f-5978-43e6-bf79-a1bf024460ff None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:34.984731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 685/1330] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:34.989855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02996b-afa4-432e-959c-c8bf2ce5a1de None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:34.990248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02996b-afa4-432e-959c-c8bf2ce5a1de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:34.990412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02996b-afa4-432e-959c-c8bf2ce5a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:35.059882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4e02996b-afa4-432e-959c-c8bf2ce5a1de None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:35.061178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e02996b-afa4-432e-959c-c8bf2ce5a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:35.157542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 646/1331] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:35.205751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:35.206039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:35.206319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:35.207699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 686/1332] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 17 08:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:35.213334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a710ad-f830-415a-b9e1-b6ec027b5f8c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:35.213705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a710ad-f830-415a-b9e1-b6ec027b5f8c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:35.214134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a710ad-f830-415a-b9e1-b6ec027b5f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:35.258136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:35.290299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e7a710ad-f830-415a-b9e1-b6ec027b5f8c None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:35.291500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e7a710ad-f830-415a-b9e1-b6ec027b5f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:35.383458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 647/1333] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 08:27:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:35.393427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:35.394953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:35.501158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f4c4-5b3f-446c-b871-12177ab61c85 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:35.572408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:35.573636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:35.573891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:35.574166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:35.575804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:35.602131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:35.686351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:35.687784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886fb16-ed92-4213-9d19-6b7f9e8eefa0 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:35.707332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 687/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:38.115585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:38.116150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:38.116250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:38.117724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 648/1335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:38.123738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cf71-fb94-4cc5-8b62-dba6abac9215 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:38.124159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cf71-fb94-4cc5-8b62-dba6abac9215 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:38.124294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cf71-fb94-4cc5-8b62-dba6abac9215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:38.187146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-63f7cf71-fb94-4cc5-8b62-dba6abac9215 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:38.188266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-63f7cf71-fb94-4cc5-8b62-dba6abac9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:38.261026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:38.282394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 688/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:38.323967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:38.325599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:38.435733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b90b-9aa6-4c4c-9c8d-86c6e8e193fa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:38.462942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:38.508141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:38.508803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:38.509081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:38.509352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:38.511940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:38.617265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:38.618703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe3b83-e2b2-4ea1-8cb3-c0889ed921c5 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:38.638630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 649/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:41.449026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:41.449623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:41.449623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:41.450978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 689/1338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:41.456312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ecd7-77e5-4faa-aa7b-3754c2ae220e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:41.456796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ecd7-77e5-4faa-aa7b-3754c2ae220e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:41.456900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ecd7-77e5-4faa-aa7b-3754c2ae220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:41.521011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-14e2ecd7-77e5-4faa-aa7b-3754c2ae220e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:41.522222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-14e2ecd7-77e5-4faa-aa7b-3754c2ae220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:41.530816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:41.618194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 650/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:41.655428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:41.657069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:41.758853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aee0b-6f22-4e96-bae0-d2e352528568 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:41.831583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:41.832228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:41.832526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:41.832800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:41.834407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:41.868980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:41.943629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:41.945476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89774-a77a-4374-ad1f-c1e4ac4cde53 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:41.964044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 690/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:46.487982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:46.488547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:46.488547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:46.490547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 651/1341] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:46.495793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e6ee7-8937-4a46-bf08-2ed3a28c8d4b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:46.496447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e6ee7-8937-4a46-bf08-2ed3a28c8d4b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:46.496854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e6ee7-8937-4a46-bf08-2ed3a28c8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:46.575570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4c1e6ee7-8937-4a46-bf08-2ed3a28c8d4b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:46.576819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4c1e6ee7-8937-4a46-bf08-2ed3a28c8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:46.675784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:46.688882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 691/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:46.729096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:46.731777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:46.828014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ec7f-5a80-44df-af9b-40e6af2eaabf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:46.831458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:46.832097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:46.832377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:46.832678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:46.842904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:46.844332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e316944-3f97-42ca-bc2d-9187a6070451 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:46.854439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 652/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:50.027357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411a98-2b26-45f3-8fc9-d85a43b5015a None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:50.027912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411a98-2b26-45f3-8fc9-d85a43b5015a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:50.027912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411a98-2b26-45f3-8fc9-d85a43b5015a None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:50.029303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 692/1344] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:27:50.034507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f5c4-9804-41bb-b0c9-9bc062b67237 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:50.035025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f5c4-9804-41bb-b0c9-9bc062b67237 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:50.035225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f5c4-9804-41bb-b0c9-9bc062b67237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:50.063581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a4f2f5c4-9804-41bb-b0c9-9bc062b67237 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:50.065012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4f2f5c4-9804-41bb-b0c9-9bc062b67237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:50.102319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:27:50.155690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 653/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:50.192710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411a98-2b26-45f3-8fc9-d85a43b5015a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:50.203856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411a98-2b26-45f3-8fc9-d85a43b5015a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:50.207359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:50.208001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:50.208280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:50.208580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:50.217450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:50.218886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653249b-e299-4ce4-92c3-82d9871123ac service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:50.228636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 693/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:54.565395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:54.565910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:54.565910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:54.567248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 654/1347] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:54.573183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3265-4616-4d7d-9ec9-08398e46c107 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:54.573669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3265-4616-4d7d-9ec9-08398e46c107 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:54.573764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3265-4616-4d7d-9ec9-08398e46c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:54.591926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-410b3265-4616-4d7d-9ec9-08398e46c107 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:54.593156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-410b3265-4616-4d7d-9ec9-08398e46c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:54.601091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 694/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:27:54.639947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:27:54.641682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:27:54.655355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbf70-a00b-49a8-bcc4-7b047e6383d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:27:54.659140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:27:54.659791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:54.660076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:54.660803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:54.670959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:27:54.671983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf29a-3aec-4d1c-b08b-7102629b6ec6 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:27:54.694668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 655/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:27:59.876511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a28c5-f174-4cca-90d1-fee11e98a4f2 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:59.876989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a28c5-f174-4cca-90d1-fee11e98a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:59.877113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a28c5-f174-4cca-90d1-fee11e98a4f2 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:59.878707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 695/1350] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:27:59.885156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1f92b-cbad-44f4-92c0-1ff0827cd3e9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:27:59.885523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1f92b-cbad-44f4-92c0-1ff0827cd3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:27:59.885774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1f92b-cbad-44f4-92c0-1ff0827cd3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:27:59.981353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a2c1f92b-cbad-44f4-92c0-1ff0827cd3e9 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:27:59.990083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2c1f92b-cbad-44f4-92c0-1ff0827cd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:00.083763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 656/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:27:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:04.334505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81cf0e-0df1-43ab-90d4-aa2c96fb7313 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:04.335013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81cf0e-0df1-43ab-90d4-aa2c96fb7313 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:04.335093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81cf0e-0df1-43ab-90d4-aa2c96fb7313 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:04.336577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 696/1352] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:04.342370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abdae-c786-45fa-8514-fc6932c7908f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:04.342843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abdae-c786-45fa-8514-fc6932c7908f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:04.342926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abdae-c786-45fa-8514-fc6932c7908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:04.361376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0a2abdae-c786-45fa-8514-fc6932c7908f None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:04.363889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0a2abdae-c786-45fa-8514-fc6932c7908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:04.374018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 657/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:04.588334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=13 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:06.009434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480f27-0874-4bfb-bf53-6a9e741f5c69 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:06.010104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480f27-0874-4bfb-bf53-6a9e741f5c69 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:06.010252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480f27-0874-4bfb-bf53-6a9e741f5c69 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:06.012678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 697/1354] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:28:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:06.018821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da374-85ef-4c7b-91c1-f70a60dbafa3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:06.019331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da374-85ef-4c7b-91c1-f70a60dbafa3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:06.019500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da374-85ef-4c7b-91c1-f70a60dbafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:06.041587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f27da374-85ef-4c7b-91c1-f70a60dbafa3 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:06.042783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f27da374-85ef-4c7b-91c1-f70a60dbafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:06.051595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 658/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:28:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:09.801568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa64ee-5248-4ae7-afd7-6857f9abf40f None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:09.802060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa64ee-5248-4ae7-afd7-6857f9abf40f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:09.802060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa64ee-5248-4ae7-afd7-6857f9abf40f None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:09.803594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 698/1356] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:09.809484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578ca7-5bb7-445a-9b14-cae0e1f981f5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:09.809927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578ca7-5bb7-445a-9b14-cae0e1f981f5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:09.810046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578ca7-5bb7-445a-9b14-cae0e1f981f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:09.828903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-61578ca7-5bb7-445a-9b14-cae0e1f981f5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:09.830037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61578ca7-5bb7-445a-9b14-cae0e1f981f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:09.838665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 659/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:09.896964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568795dc-ef6f-467c-add9-d7f2a5511fb7 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:09.897695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568795dc-ef6f-467c-add9-d7f2a5511fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:09.898377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568795dc-ef6f-467c-add9-d7f2a5511fb7 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:09.901087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 699/1358] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 08:28:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:09.918931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1090f-1f5e-487d-be51-f71768a0e219 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:09.919562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1090f-1f5e-487d-be51-f71768a0e219 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:09.920316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1090f-1f5e-487d-be51-f71768a0e219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:09.976832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:10.028619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dbd1090f-1f5e-487d-be51-f71768a0e219 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:10.028619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dbd1090f-1f5e-487d-be51-f71768a0e219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:10.077464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 660/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:10.125994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568795dc-ef6f-467c-add9-d7f2a5511fb7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:10.125994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568795dc-ef6f-467c-add9-d7f2a5511fb7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:10.125994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:10.125994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:10.127066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:10.127066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:10.127066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:10.127066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9091-1ae6-439d-bad9-afb0f982baee service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:10.128304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 700/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:12.488279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de047-14d6-4fb0-b3e9-fa847ead6f1f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:12.488883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de047-14d6-4fb0-b3e9-fa847ead6f1f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:12.488883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93de047-14d6-4fb0-b3e9-fa847ead6f1f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:12.492868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 661/1361] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:12.495712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68e5d-c950-4fe2-a80a-ca0ad94525d9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:12.496166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68e5d-c950-4fe2-a80a-ca0ad94525d9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:12.496254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68e5d-c950-4fe2-a80a-ca0ad94525d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:12.514904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c8c68e5d-c950-4fe2-a80a-ca0ad94525d9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:12.516412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c8c68e5d-c950-4fe2-a80a-ca0ad94525d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:12.528709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 701/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:12.573634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93de047-14d6-4fb0-b3e9-fa847ead6f1f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:12.592935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93de047-14d6-4fb0-b3e9-fa847ead6f1f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:12.600412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:12.601141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:12.601422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:12.601780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:12.612332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:12.614083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb66f-ffc9-4f9b-ae87-b432219463dd service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:12.626037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 662/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:15.250072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2a69-0da9-487f-92de-751c46b375ae None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:15.250573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2a69-0da9-487f-92de-751c46b375ae None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:15.250656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2a69-0da9-487f-92de-751c46b375ae None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:15.252152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 702/1364] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:15.257194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de4ff-93a6-469e-9528-e7d073d3cb92 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:15.258502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de4ff-93a6-469e-9528-e7d073d3cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:15.258874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de4ff-93a6-469e-9528-e7d073d3cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:15.278791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e87de4ff-93a6-469e-9528-e7d073d3cb92 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:15.280158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e87de4ff-93a6-469e-9528-e7d073d3cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:15.288183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 663/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:15.335011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792b23-8d33-42a6-b06c-6c22d0bf3840 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:15.335011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792b23-8d33-42a6-b06c-6c22d0bf3840 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:15.335362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792b23-8d33-42a6-b06c-6c22d0bf3840 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:15.337684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 703/1366] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 08:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:15.343472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd420c-2963-4476-bc2a-8f501ca2cb05 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:15.344460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd420c-2963-4476-bc2a-8f501ca2cb05 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:15.344460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd420c-2963-4476-bc2a-8f501ca2cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:15.363622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c2dd420c-2963-4476-bc2a-8f501ca2cb05 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:15.365090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2dd420c-2963-4476-bc2a-8f501ca2cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:15.375294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 664/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:15.384049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa792b23-8d33-42a6-b06c-6c22d0bf3840 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:15.405213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa792b23-8d33-42a6-b06c-6c22d0bf3840 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:15.410720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:15.411373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:15.411658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:15.411938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:15.429345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:15.431176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1e13-0cb1-4483-86ad-9df7b7cd6607 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:15.443632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 704/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:17.793397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb26-6d8e-425a-b40e-6bb8086e9bd6 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:17.793970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb26-6d8e-425a-b40e-6bb8086e9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:17.793970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb26-6d8e-425a-b40e-6bb8086e9bd6 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:17.795518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 665/1369] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:17.800632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6347e-9c5d-4a06-9db0-b26d6ceb1def None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:17.801068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6347e-9c5d-4a06-9db0-b26d6ceb1def None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:17.801166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6347e-9c5d-4a06-9db0-b26d6ceb1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:17.820054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-75d6347e-9c5d-4a06-9db0-b26d6ceb1def None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:17.821649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-75d6347e-9c5d-4a06-9db0-b26d6ceb1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:17.829744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 705/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:17.874984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286eb26-6d8e-425a-b40e-6bb8086e9bd6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:17.890655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286eb26-6d8e-425a-b40e-6bb8086e9bd6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:17.898899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:17.898899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:17.898899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:17.898899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:17.910252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:17.912825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29b1b1-79cf-4776-9929-6cd3efe4d047 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:17.926919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 666/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:18.092347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feac0-c758-4715-b028-bfb7944f8201 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:18.092668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feac0-c758-4715-b028-bfb7944f8201 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:18.092943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feac0-c758-4715-b028-bfb7944f8201 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:18.094338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 706/1372] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:18.099601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a62b-be8e-4275-9bef-68e8f7c914b9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:18.103174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a62b-be8e-4275-9bef-68e8f7c914b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:18.103174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a62b-be8e-4275-9bef-68e8f7c914b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:18.119032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e508a62b-be8e-4275-9bef-68e8f7c914b9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:18.120517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e508a62b-be8e-4275-9bef-68e8f7c914b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:18.128529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 667/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:28:18.443382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe594fb-75ec-4cd5-bdc1-ef15b34ffc27 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:18.443382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe594fb-75ec-4cd5-bdc1-ef15b34ffc27 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:18.443382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe594fb-75ec-4cd5-bdc1-ef15b34ffc27 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:18.443382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 707/1374] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 17 08:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:18.448388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218f62-84ec-4d6b-8e5b-3a278c7eca8f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:18.448714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218f62-84ec-4d6b-8e5b-3a278c7eca8f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:18.448987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218f62-84ec-4d6b-8e5b-3a278c7eca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:18.500307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e8218f62-84ec-4d6b-8e5b-3a278c7eca8f None None] MFA Rules not processed for user `8ec5d01659b2451fbbd9e2d5647b9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:18.501546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e8218f62-84ec-4d6b-8e5b-3a278c7eca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:18.570901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 668/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 17 08:28:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:18.575283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe594fb-75ec-4cd5-bdc1-ef15b34ffc27 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:18.587821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe594fb-75ec-4cd5-bdc1-ef15b34ffc27 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:18.591377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:18.592894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:18.593349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:18.593799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:18.606470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:18.608112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500e75-dd60-487c-b13f-d8b23e334d38 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:18.620471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 708/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:20.290860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a1cf3-6d7d-402c-b58f-36eb17adc173 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:20.291368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a1cf3-6d7d-402c-b58f-36eb17adc173 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:20.291368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a1cf3-6d7d-402c-b58f-36eb17adc173 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:20.292745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 669/1377] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:20.301961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507ac7-75ad-42d7-bad0-dff961713819 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:20.301961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507ac7-75ad-42d7-bad0-dff961713819 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:20.301961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507ac7-75ad-42d7-bad0-dff961713819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:20.317773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-79507ac7-75ad-42d7-bad0-dff961713819 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:20.319158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-79507ac7-75ad-42d7-bad0-dff961713819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:20.327787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 709/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:20.377194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a1cf3-6d7d-402c-b58f-36eb17adc173 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:20.392112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a1cf3-6d7d-402c-b58f-36eb17adc173 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:20.398495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:20.399164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:20.399446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:20.399719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:20.408953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:20.410598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ddf6c-d6d8-44e1-ae49-1ff480409675 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:20.415616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:20.422173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 670/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:22.784414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b56-bcce-4f48-aaf5-dc6b9f6142ee None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:22.784989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b56-bcce-4f48-aaf5-dc6b9f6142ee None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:22.784989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b56-bcce-4f48-aaf5-dc6b9f6142ee None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:22.786373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 710/1380] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:22.792408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7b6b-0f67-4b72-afc0-c37c6b19613a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:22.792845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7b6b-0f67-4b72-afc0-c37c6b19613a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:22.793009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7b6b-0f67-4b72-afc0-c37c6b19613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:22.812337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e1df7b6b-0f67-4b72-afc0-c37c6b19613a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:22.813804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e1df7b6b-0f67-4b72-afc0-c37c6b19613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:22.822613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 671/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:22.867284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9b56-bcce-4f48-aaf5-dc6b9f6142ee None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:22.881920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9b56-bcce-4f48-aaf5-dc6b9f6142ee None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:22.887519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:22.888165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:22.888525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:22.888807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:22.899240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:22.901612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c650e-5811-446c-82dc-3bd4b3cd6cd4 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:22.916464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 711/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:25.277146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1450-963a-431f-bdec-1d289a597363 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:25.277697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1450-963a-431f-bdec-1d289a597363 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:25.277697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1450-963a-431f-bdec-1d289a597363 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:25.279067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 672/1383] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:25.284304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81f3b-f9d1-4e51-9096-eb75870d423d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:25.284749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81f3b-f9d1-4e51-9096-eb75870d423d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:25.284901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f81f3b-f9d1-4e51-9096-eb75870d423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:25.303165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e6f81f3b-f9d1-4e51-9096-eb75870d423d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:25.305072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e6f81f3b-f9d1-4e51-9096-eb75870d423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:25.313133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 712/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:25.354644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1450-963a-431f-bdec-1d289a597363 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:25.370737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1450-963a-431f-bdec-1d289a597363 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:25.376408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:25.377191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:25.377584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:25.377993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:25.388125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:25.389888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfd53c-2573-4647-b88c-8b405f9949ff service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:25.400478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 673/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:27.765977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f676b-f656-42fd-8e05-b1e3022c3cc4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:27.766532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f676b-f656-42fd-8e05-b1e3022c3cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:27.766630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f676b-f656-42fd-8e05-b1e3022c3cc4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:27.768009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 713/1386] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:27.774282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788809-abee-4699-9313-7d403a98759f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:27.774731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788809-abee-4699-9313-7d403a98759f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:27.774871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788809-abee-4699-9313-7d403a98759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:27.794075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0a788809-abee-4699-9313-7d403a98759f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:27.795338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0a788809-abee-4699-9313-7d403a98759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:27.803666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 674/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:27.851501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f676b-f656-42fd-8e05-b1e3022c3cc4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:27.867216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f676b-f656-42fd-8e05-b1e3022c3cc4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:27.873042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:27.873697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:27.873982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:27.874262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:27.883139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:27.884772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d7b5-af6d-4caa-b97a-838dc60f2f3e service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:27.894788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 714/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:30.409198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722dd6-60a1-4d36-9553-2bedf2606652 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:30.409729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722dd6-60a1-4d36-9553-2bedf2606652 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:30.409865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722dd6-60a1-4d36-9553-2bedf2606652 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:30.411650 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 675/1389] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:30.418540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c337f-2aeb-4990-a58d-98971f1b54a8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:30.419106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c337f-2aeb-4990-a58d-98971f1b54a8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:30.419106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c337f-2aeb-4990-a58d-98971f1b54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:30.438055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4e9c337f-2aeb-4990-a58d-98971f1b54a8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:30.439257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4e9c337f-2aeb-4990-a58d-98971f1b54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:30.447729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 715/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:30.495358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06722dd6-60a1-4d36-9553-2bedf2606652 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:30.511786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06722dd6-60a1-4d36-9553-2bedf2606652 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:30.517272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:30.517918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:30.518204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:30.518481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:30.527936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:30.529589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f434d90-1f43-4961-ae7d-0b9fd5253a6b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:30.539375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 676/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:32.880776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c429150-d590-43fe-a000-1a66bfebddd4 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:32.881284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c429150-d590-43fe-a000-1a66bfebddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:32.881284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c429150-d590-43fe-a000-1a66bfebddd4 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:32.883506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 716/1392] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:32.888856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085e62-039e-4f04-911f-c8779ad04014 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:32.889319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085e62-039e-4f04-911f-c8779ad04014 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:32.889482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085e62-039e-4f04-911f-c8779ad04014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:32.908074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-73085e62-039e-4f04-911f-c8779ad04014 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:32.909301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73085e62-039e-4f04-911f-c8779ad04014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:32.917722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 677/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:32.962646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c429150-d590-43fe-a000-1a66bfebddd4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:32.977712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c429150-d590-43fe-a000-1a66bfebddd4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:32.983170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:32.983815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:32.984097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:32.984376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:32.993612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:32.995506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d12a9-0681-4486-b8ed-5ddecfabb691 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:33.005639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 717/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:34.443291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f35c9-4102-4761-b696-f940ddfcbfc3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:34.443942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f35c9-4102-4761-b696-f940ddfcbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:34.443942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f35c9-4102-4761-b696-f940ddfcbfc3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:34.445426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 678/1395] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:34.450519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ead5-d65a-40f4-bcf9-ce019d438fec None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:34.450951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ead5-d65a-40f4-bcf9-ce019d438fec None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:34.451077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ead5-d65a-40f4-bcf9-ce019d438fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:34.469689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4c21ead5-d65a-40f4-bcf9-ce019d438fec None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:34.470882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4c21ead5-d65a-40f4-bcf9-ce019d438fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:34.479710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 718/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:28:34.534705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cfa9-65fa-429a-a5f2-043e9a8c516e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:34.534908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cfa9-65fa-429a-a5f2-043e9a8c516e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:34.535181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cfa9-65fa-429a-a5f2-043e9a8c516e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:34.536719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 679/1397] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 17 08:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:34.541986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef37-b5dd-47c5-b573-9351977acb0c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:34.542273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef37-b5dd-47c5-b573-9351977acb0c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:34.542552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef37-b5dd-47c5-b573-9351977acb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:34.590993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ac0aef37-b5dd-47c5-b573-9351977acb0c None None] MFA Rules not processed for user `abab3be86e7f48ad8cfc406f4c6c988d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:34.592948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ac0aef37-b5dd-47c5-b573-9351977acb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:34.754982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=84 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:34.777743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 719/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 17 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:34.785160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9cfa9-65fa-429a-a5f2-043e9a8c516e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:34.796802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9cfa9-65fa-429a-a5f2-043e9a8c516e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:34.800198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:34.800862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:34.801207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:34.801478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:34.811444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:34.812890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb6f7-24d3-4c03-a7da-fb22745d4993 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:34.822649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 680/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:35.303912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c229-7cb9-4d48-88c0-e4456dd5b2cb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.304303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c229-7cb9-4d48-88c0-e4456dd5b2cb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.304623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15c229-7cb9-4d48-88c0-e4456dd5b2cb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:35.306006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 720/1400] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:35.311385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ce0b-d01d-4bc0-8abc-0a39972c922d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.311674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ce0b-d01d-4bc0-8abc-0a39972c922d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.311951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ce0b-d01d-4bc0-8abc-0a39972c922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:35.330647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d784ce0b-d01d-4bc0-8abc-0a39972c922d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:35.331878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d784ce0b-d01d-4bc0-8abc-0a39972c922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:35.343178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 681/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:35.389536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15c229-7cb9-4d48-88c0-e4456dd5b2cb None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:35.404986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15c229-7cb9-4d48-88c0-e4456dd5b2cb None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:35.410601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:35.411387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.411671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.411943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:35.431015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:35.432651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38033041-7ba7-4810-a0cf-87ad190a8f89 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:35.442166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 721/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:35.786459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33cc17-0669-4e02-8ad8-7ab853046e0f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.787047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33cc17-0669-4e02-8ad8-7ab853046e0f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.787047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33cc17-0669-4e02-8ad8-7ab853046e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:35.843117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5d33cc17-0669-4e02-8ad8-7ab853046e0f None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:35.844410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5d33cc17-0669-4e02-8ad8-7ab853046e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:35.909406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 682/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:28:35.958058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b01e7-e940-409b-84ed-228de6b489e5 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.958665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b01e7-e940-409b-84ed-228de6b489e5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.958665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b01e7-e940-409b-84ed-228de6b489e5 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:35.960182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 722/1404] 10.222.0.48 () {54 vars in 942 bytes} [Fri Jun 17 08:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:35.966911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ea20-9abb-47b1-a78b-9ee86916512b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:35.967301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ea20-9abb-47b1-a78b-9ee86916512b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:35.967646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ea20-9abb-47b1-a78b-9ee86916512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:36.017892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0175ea20-9abb-47b1-a78b-9ee86916512b None None] MFA Rules not processed for user `aad40b6b9b26414a9d87746b77c9e560`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:36.019095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0175ea20-9abb-47b1-a78b-9ee86916512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:36.057970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:36.103652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 683/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Fri Jun 17 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:36.113330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b01e7-e940-409b-84ed-228de6b489e5 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:36.128525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b01e7-e940-409b-84ed-228de6b489e5 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:36.134505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:36.135264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:36.135684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:36.136015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:36.146044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:36.148105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1cd9-b887-4cf8-a930-3f9e2d1d5859 service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:36.157256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 723/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:28:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:28:37.761159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199f7d-0167-43ca-a61c-6b98ad60a300 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:37.761778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199f7d-0167-43ca-a61c-6b98ad60a300 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:37.761778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199f7d-0167-43ca-a61c-6b98ad60a300 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:37.763095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 684/1407] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:28:37.769796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108bac1-17aa-4d1f-b569-a21547fcb1c1 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:37.770575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108bac1-17aa-4d1f-b569-a21547fcb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:37.770854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108bac1-17aa-4d1f-b569-a21547fcb1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:37.792335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0108bac1-17aa-4d1f-b569-a21547fcb1c1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:28:37.794557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0108bac1-17aa-4d1f-b569-a21547fcb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:28:37.802793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 724/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:28:37.848681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68199f7d-0167-43ca-a61c-6b98ad60a300 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:28:37.864330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68199f7d-0167-43ca-a61c-6b98ad60a300 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:28:37.870258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:28:37.870910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:28:37.871229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:28:37.871614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:28:37.880681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:28:37.883147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d73d-1cec-41b0-b184-1d4cab66712c service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:28:37.895111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 685/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:28:47.786380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=23 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:47.889212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=21 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:00.401246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1176-dfc6-40ab-ac33-579c15c3149a None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:00.401781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1176-dfc6-40ab-ac33-579c15c3149a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:00.401781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1176-dfc6-40ab-ac33-579c15c3149a None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:00.403179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 725/1410] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 17 08:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:00.408174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15f270-4377-4b17-b578-e0dcaed40585 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:00.408605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15f270-4377-4b17-b578-e0dcaed40585 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:00.408756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15f270-4377-4b17-b578-e0dcaed40585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:00.428196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b15f270-4377-4b17-b578-e0dcaed40585 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:00.429406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b15f270-4377-4b17-b578-e0dcaed40585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:00.437748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 686/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 17 08:29:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:00.451825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0b62-fa30-4e8e-aff4-a4274dab02f0 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:00.452112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0b62-fa30-4e8e-aff4-a4274dab02f0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:00.452385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0b62-fa30-4e8e-aff4-a4274dab02f0 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:00.453774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 726/1412] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 17 08:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:00.458226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d0dc-f4b9-4420-a09a-abdbfb124ad5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:00.458535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d0dc-f4b9-4420-a09a-abdbfb124ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:00.458812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d0dc-f4b9-4420-a09a-abdbfb124ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:00.477735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac47d0dc-f4b9-4420-a09a-abdbfb124ad5 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:00.478916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac47d0dc-f4b9-4420-a09a-abdbfb124ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:00.487915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 687/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 17 08:29:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:03.082490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6086786-f640-4d56-9330-9edfdea057b6 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:03.083645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6086786-f640-4d56-9330-9edfdea057b6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:03.083645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6086786-f640-4d56-9330-9edfdea057b6 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:03.084328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 727/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:03.089580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789edf0-876b-4eb0-9964-9d0bc3c187f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:03.089996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789edf0-876b-4eb0-9964-9d0bc3c187f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:03.090138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789edf0-876b-4eb0-9964-9d0bc3c187f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:03.108292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8789edf0-876b-4eb0-9964-9d0bc3c187f7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:03.109546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8789edf0-876b-4eb0-9964-9d0bc3c187f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:03.118640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 688/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:03.161625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6086786-f640-4d56-9330-9edfdea057b6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:03.175814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6086786-f640-4d56-9330-9edfdea057b6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:03.182067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:03.182982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:03.183263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:03.183532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:03.191805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:03.194086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a3eb4-439d-4a68-a8e5-8e323294494a service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:03.203451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 728/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:04.153431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deb2e-1f7d-4a39-91ea-12c1b6c645da None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:04.153985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deb2e-1f7d-4a39-91ea-12c1b6c645da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:04.154089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deb2e-1f7d-4a39-91ea-12c1b6c645da None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:04.155381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 689/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:04.160410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b05b-3255-40e6-b25d-1916a36d9b65 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:04.161145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b05b-3255-40e6-b25d-1916a36d9b65 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:04.161145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b05b-3255-40e6-b25d-1916a36d9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:04.178352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-cec5b05b-3255-40e6-b25d-1916a36d9b65 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:04.179538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cec5b05b-3255-40e6-b25d-1916a36d9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:04.187344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 729/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:04.339795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12deb2e-1f7d-4a39-91ea-12c1b6c645da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:04.353801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12deb2e-1f7d-4a39-91ea-12c1b6c645da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:04.359073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:04.359712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:04.359992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:04.360267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:04.368877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:04.370719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e02d6-2f11-45a3-bf81-e9ddafdf60af service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:04.380679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 690/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:05.315516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1a23-cb5d-4100-bc74-3cbd97e2dd45 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:05.316055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1a23-cb5d-4100-bc74-3cbd97e2dd45 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:05.316055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e1a23-cb5d-4100-bc74-3cbd97e2dd45 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:05.317696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 730/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:05.322554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921205d-ff0e-42cf-b14e-6f4d7a866935 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:05.323001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921205d-ff0e-42cf-b14e-6f4d7a866935 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:05.323111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921205d-ff0e-42cf-b14e-6f4d7a866935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:05.341204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2921205d-ff0e-42cf-b14e-6f4d7a866935 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:05.342388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2921205d-ff0e-42cf-b14e-6f4d7a866935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:05.350934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 691/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:05.501573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e1a23-cb5d-4100-bc74-3cbd97e2dd45 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:05.516286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e1a23-cb5d-4100-bc74-3cbd97e2dd45 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:05.522335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:05.522971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:05.523249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:05.523521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:05.531567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:05.533184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf6748-01fd-442e-bea4-ed97a3c0b3a9 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:05.542703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 731/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:29:06.452398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585760-384a-48a8-b692-b28f08c2da96 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:06.452963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585760-384a-48a8-b692-b28f08c2da96 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:06.452963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585760-384a-48a8-b692-b28f08c2da96 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:06.454355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 692/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:06.460357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc1ee-1904-44b6-a180-b29f1d73a7e9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:06.460809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc1ee-1904-44b6-a180-b29f1d73a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:06.460977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc1ee-1904-44b6-a180-b29f1d73a7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:06.478514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e15cc1ee-1904-44b6-a180-b29f1d73a7e9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:06.479766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e15cc1ee-1904-44b6-a180-b29f1d73a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:06.487867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 732/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:06.640769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585760-384a-48a8-b692-b28f08c2da96 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:06.655418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585760-384a-48a8-b692-b28f08c2da96 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:06.660854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:06.661480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:06.661763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:06.662040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:06.670766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:06.672346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca4e3-9c90-4244-875a-e52588cd69c4 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:06.682856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 693/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:07.598037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8f99-a88b-4555-85c3-7c866075fb11 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:07.598577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8f99-a88b-4555-85c3-7c866075fb11 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:07.598675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8f99-a88b-4555-85c3-7c866075fb11 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:07.600025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 733/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:07.605601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e130a3-ce4b-415e-af40-918c5f1f2157 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:07.606261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e130a3-ce4b-415e-af40-918c5f1f2157 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:07.606261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e130a3-ce4b-415e-af40-918c5f1f2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:07.624995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d5e130a3-ce4b-415e-af40-918c5f1f2157 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:07.626186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d5e130a3-ce4b-415e-af40-918c5f1f2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:07.635014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 694/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:07.789881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8f99-a88b-4555-85c3-7c866075fb11 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:07.804859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8f99-a88b-4555-85c3-7c866075fb11 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:07.810115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:07.810742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:07.811020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:07.811291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:07.819568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:07.821170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcfc7f-f07b-4caf-a875-2b9cc2a7d9db service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:07.830490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 734/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:08.836526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e12f-9a5b-40f4-91a4-5a85a59340d4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:08.837056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e12f-9a5b-40f4-91a4-5a85a59340d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:08.837056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e12f-9a5b-40f4-91a4-5a85a59340d4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:08.838458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 695/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:08.843430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d3e8-c3b2-4f7a-b6aa-7867c2d83fcc None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:08.843850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d3e8-c3b2-4f7a-b6aa-7867c2d83fcc None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:08.843980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d3e8-c3b2-4f7a-b6aa-7867c2d83fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:08.861272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8ab7d3e8-c3b2-4f7a-b6aa-7867c2d83fcc None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:08.862455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8ab7d3e8-c3b2-4f7a-b6aa-7867c2d83fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:08.871649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 735/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:09.024875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e12f-9a5b-40f4-91a4-5a85a59340d4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:09.039264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e12f-9a5b-40f4-91a4-5a85a59340d4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:09.044745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:09.045377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:09.045662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:09.045940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:09.054445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:09.056046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084586-da96-4c9b-9dad-a114b78156c1 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:09.067730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 696/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:10.098950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ab6d-bf8b-49b6-a1ee-81ec02d28dfd None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:10.099501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ab6d-bf8b-49b6-a1ee-81ec02d28dfd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:10.099611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ab6d-bf8b-49b6-a1ee-81ec02d28dfd None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:10.100970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 736/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:10.105958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d035fb-85a1-4a0e-be12-5768fc789a19 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:10.106360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d035fb-85a1-4a0e-be12-5768fc789a19 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:10.106512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d035fb-85a1-4a0e-be12-5768fc789a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:10.125303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-10d035fb-85a1-4a0e-be12-5768fc789a19 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:10.126508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10d035fb-85a1-4a0e-be12-5768fc789a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:10.135066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 697/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:10.287308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ab6d-bf8b-49b6-a1ee-81ec02d28dfd None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:10.302023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ab6d-bf8b-49b6-a1ee-81ec02d28dfd None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:10.307374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:10.308015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:10.308287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:10.308600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:10.316574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:10.318242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765b727-b491-43b1-b9a6-596754efd759 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:10.328423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 737/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:11.254067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17022-e2d6-41ea-951a-e9504b54bc38 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:11.254729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17022-e2d6-41ea-951a-e9504b54bc38 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:11.254729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17022-e2d6-41ea-951a-e9504b54bc38 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:11.256062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 698/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:11.261196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3219e-da8e-48c2-a874-85ad26133e88 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:11.261617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3219e-da8e-48c2-a874-85ad26133e88 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:11.261741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3219e-da8e-48c2-a874-85ad26133e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:11.279971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4bc3219e-da8e-48c2-a874-85ad26133e88 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:11.281213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4bc3219e-da8e-48c2-a874-85ad26133e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:11.289577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 738/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:11.443298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef17022-e2d6-41ea-951a-e9504b54bc38 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:11.458188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef17022-e2d6-41ea-951a-e9504b54bc38 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:11.463496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:11.464131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:11.464802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:11.465085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:11.474223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:11.475849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03498393-6d87-48ba-a7b8-839db9fd3dd3 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:11.485919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 699/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:12.396060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a268c-d8d5-4cc8-97be-2703fea4b451 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:12.396698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a268c-d8d5-4cc8-97be-2703fea4b451 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:12.396698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a268c-d8d5-4cc8-97be-2703fea4b451 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:12.398003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 739/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:12.402857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6806-cb71-444e-a4ed-bf65fef5f704 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:12.403310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6806-cb71-444e-a4ed-bf65fef5f704 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:12.403424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6806-cb71-444e-a4ed-bf65fef5f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:12.421501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-51cf6806-cb71-444e-a4ed-bf65fef5f704 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:12.422699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-51cf6806-cb71-444e-a4ed-bf65fef5f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:12.430979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 700/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:12.589331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a268c-d8d5-4cc8-97be-2703fea4b451 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:12.603878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a268c-d8d5-4cc8-97be-2703fea4b451 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:12.609269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:12.609905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:12.610187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:12.610458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:12.619874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:12.620979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779c01d-28f7-49fb-984c-5f4b6c531e73 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:12.631113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 740/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:14.663530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c388d5-fa24-46e1-adca-9b60a80e4444 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:14.664105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c388d5-fa24-46e1-adca-9b60a80e4444 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:14.664334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c388d5-fa24-46e1-adca-9b60a80e4444 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:14.666245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 701/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:14.671775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df243-4bf9-4fa0-8a8d-075ced1fab6d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:14.672237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df243-4bf9-4fa0-8a8d-075ced1fab6d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:14.672344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df243-4bf9-4fa0-8a8d-075ced1fab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:14.689927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c70df243-4bf9-4fa0-8a8d-075ced1fab6d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:14.691730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c70df243-4bf9-4fa0-8a8d-075ced1fab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:14.699854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 741/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:29:14.738882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c388d5-fa24-46e1-adca-9b60a80e4444 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:14.749833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c388d5-fa24-46e1-adca-9b60a80e4444 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:14.753364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:14.754491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:14.754768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:14.755041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:14.763791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:14.765253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b8dce-2d27-4c5c-a7be-447d9778c087 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:14.774950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 702/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:17.140692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e80f9-a294-49db-9c5f-5c885f1bc741 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:17.141253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e80f9-a294-49db-9c5f-5c885f1bc741 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:17.141253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e80f9-a294-49db-9c5f-5c885f1bc741 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:17.142609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 742/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:17.148029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49067-bfc7-4123-864a-d71ddd1b54d4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:17.148437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49067-bfc7-4123-864a-d71ddd1b54d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:17.148654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49067-bfc7-4123-864a-d71ddd1b54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:17.167369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7af49067-bfc7-4123-864a-d71ddd1b54d4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:17.168697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7af49067-bfc7-4123-864a-d71ddd1b54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:17.177312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 703/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:17.216165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e80f9-a294-49db-9c5f-5c885f1bc741 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:17.228449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e80f9-a294-49db-9c5f-5c885f1bc741 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:17.232027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:17.232693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:17.232971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:17.233241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:17.243006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:17.244772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91d84a-31ed-4eec-8274-f8631d0de456 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:17.254911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 743/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:19.821136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c032-431a-444b-b01f-ac4e5989090b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:19.821697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c032-431a-444b-b01f-ac4e5989090b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:19.821697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c032-431a-444b-b01f-ac4e5989090b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:19.823083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 704/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:19.828178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c478-0ecd-4e14-bd16-c8eeeae8bc7d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:19.828602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c478-0ecd-4e14-bd16-c8eeeae8bc7d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:19.828765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c478-0ecd-4e14-bd16-c8eeeae8bc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:19.846108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d582c478-0ecd-4e14-bd16-c8eeeae8bc7d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:19.847941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d582c478-0ecd-4e14-bd16-c8eeeae8bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:19.855682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 744/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:19.894089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c032-431a-444b-b01f-ac4e5989090b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:19.904963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c032-431a-444b-b01f-ac4e5989090b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:19.908464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:19.909139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:19.909943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:19.910227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:19.919412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:19.920876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6617-d6b7-4dc3-8586-ac5c9eeaf96b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:19.931125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 705/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:22.229732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e19f6-9eb9-448b-83cf-de8c2f2ea76c None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:22.230259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e19f6-9eb9-448b-83cf-de8c2f2ea76c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:22.230259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e19f6-9eb9-448b-83cf-de8c2f2ea76c None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:22.231635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 745/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:22.237062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507637-74a5-4eab-9a17-e830903b383c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:22.237519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507637-74a5-4eab-9a17-e830903b383c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:22.237616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507637-74a5-4eab-9a17-e830903b383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:22.255523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e6507637-74a5-4eab-9a17-e830903b383c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:22.256757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6507637-74a5-4eab-9a17-e830903b383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:22.264336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 706/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:29:22.303486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e19f6-9eb9-448b-83cf-de8c2f2ea76c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:22.313952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e19f6-9eb9-448b-83cf-de8c2f2ea76c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:22.317978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:22.318607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:22.318888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:22.319161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:22.327866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:22.329315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eaced-2192-4a6b-a0a4-4fe3f31c8fc3 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:22.339344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 746/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:24.633962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258588f-5bff-4217-945b-f3ac812ff3de None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:24.634380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258588f-5bff-4217-945b-f3ac812ff3de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:24.634558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258588f-5bff-4217-945b-f3ac812ff3de None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:24.635939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 707/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:24.641040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144375-cc03-4a11-8333-c78cf4f88793 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:24.641475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144375-cc03-4a11-8333-c78cf4f88793 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:24.641579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144375-cc03-4a11-8333-c78cf4f88793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:24.658752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-77144375-cc03-4a11-8333-c78cf4f88793 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:24.660039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-77144375-cc03-4a11-8333-c78cf4f88793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:24.667759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 747/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:24.705877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258588f-5bff-4217-945b-f3ac812ff3de None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:24.716348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258588f-5bff-4217-945b-f3ac812ff3de None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:24.719823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:24.720458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:24.720770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:24.721049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:24.729919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:24.731370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180085e-3524-4d4e-bba6-a91f36a02c25 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:24.741196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 708/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:26.928285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f21d-b366-4680-8ab9-45314fdb6e66 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:26.928795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f21d-b366-4680-8ab9-45314fdb6e66 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:26.928900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f21d-b366-4680-8ab9-45314fdb6e66 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:26.930243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 748/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:26.935727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffe-4a9e-4bdf-9887-342f233ab3d9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:26.936128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffe-4a9e-4bdf-9887-342f233ab3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:26.936279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffe-4a9e-4bdf-9887-342f233ab3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:26.953570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c24fdffe-4a9e-4bdf-9887-342f233ab3d9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:26.954785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c24fdffe-4a9e-4bdf-9887-342f233ab3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:26.963085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 709/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:27.001207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f21d-b366-4680-8ab9-45314fdb6e66 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:27.012011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f21d-b366-4680-8ab9-45314fdb6e66 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:27.015852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:27.016569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:27.016854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:27.017129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:27.027181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:27.028640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ba34-90b7-4192-a45a-36e14bde69ff service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:27.038911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 749/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:29.228940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4707-5326-4472-97dc-de1d9a81c5ef None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:29.229454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4707-5326-4472-97dc-de1d9a81c5ef None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:29.229454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4707-5326-4472-97dc-de1d9a81c5ef None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:29.230788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 710/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:29.235913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520fff-0bc6-4595-8313-2eb6b5c63b7e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:29.236294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520fff-0bc6-4595-8313-2eb6b5c63b7e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:29.236468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520fff-0bc6-4595-8313-2eb6b5c63b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:29.243025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=70 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:29.255363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e2520fff-0bc6-4595-8313-2eb6b5c63b7e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:29.256583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e2520fff-0bc6-4595-8313-2eb6b5c63b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:29.264415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 750/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:29.309319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd4707-5326-4472-97dc-de1d9a81c5ef None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:29.314692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=73 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:29.321226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd4707-5326-4472-97dc-de1d9a81c5ef None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:29.324821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:29.325467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:29.325753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:29.326028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:29.335427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:29.336898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c79eb-5172-412f-b22d-be5d6d401aa6 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:29.347888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 711/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:31.517835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf036-df52-4490-8e35-5df7166ae2c6 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:31.518819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf036-df52-4490-8e35-5df7166ae2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:31.518819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf036-df52-4490-8e35-5df7166ae2c6 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:31.520092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 751/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:31.531027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e67f9-9ab5-48cc-911f-576d2785950f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:31.531027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e67f9-9ab5-48cc-911f-576d2785950f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:31.531027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e67f9-9ab5-48cc-911f-576d2785950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:31.543913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-418e67f9-9ab5-48cc-911f-576d2785950f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:31.545168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-418e67f9-9ab5-48cc-911f-576d2785950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:31.553685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 712/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:29:31.591516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf036-df52-4490-8e35-5df7166ae2c6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:31.602244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf036-df52-4490-8e35-5df7166ae2c6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:31.605749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:31.606794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:31.607082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:31.607359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:31.617057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:31.618797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcfc90-66b2-4e4e-a512-bc4803ee1f06 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:31.629043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 752/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:33.810606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0355d-bafa-48e7-8c62-4b797cb1cee4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:33.811144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0355d-bafa-48e7-8c62-4b797cb1cee4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:33.811144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0355d-bafa-48e7-8c62-4b797cb1cee4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:33.812541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 713/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:33.818037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8651-69ef-42fe-8471-b7a00ba7dc9a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:33.818430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8651-69ef-42fe-8471-b7a00ba7dc9a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:33.818590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8651-69ef-42fe-8471-b7a00ba7dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:33.836398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-95cf8651-69ef-42fe-8471-b7a00ba7dc9a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:33.837610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-95cf8651-69ef-42fe-8471-b7a00ba7dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:33.845260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 753/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:29:33.881912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0355d-bafa-48e7-8c62-4b797cb1cee4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:33.892514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0355d-bafa-48e7-8c62-4b797cb1cee4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:33.896802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:33.897447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:33.897733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:33.898006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:33.907402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:33.909751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd56a6-590a-4d3a-8979-253036d70108 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:33.919440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 714/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:36.051519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73545d8-21c7-443f-9f9e-0370086cbbdb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:36.052075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73545d8-21c7-443f-9f9e-0370086cbbdb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:36.052075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73545d8-21c7-443f-9f9e-0370086cbbdb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:36.053471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 754/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:36.058690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a249d2-b315-4665-aa57-72c6e267bf93 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:36.059133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a249d2-b315-4665-aa57-72c6e267bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:36.059228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a249d2-b315-4665-aa57-72c6e267bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:36.077575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9a249d2-b315-4665-aa57-72c6e267bf93 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:36.078752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9a249d2-b315-4665-aa57-72c6e267bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:36.086978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 715/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:29:36.123785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73545d8-21c7-443f-9f9e-0370086cbbdb None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:36.135195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73545d8-21c7-443f-9f9e-0370086cbbdb None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:36.138677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:36.139311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:36.139592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:36.139867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:36.148694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:36.150122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a27a-277b-4186-8651-74eb5c36bf8e service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:36.159452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 755/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:46.072627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=17 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:46.155336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=17 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:56.543685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f0e3e-c59d-46e6-a1ad-51e0afb116aa None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:56.544254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f0e3e-c59d-46e6-a1ad-51e0afb116aa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:56.544254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f0e3e-c59d-46e6-a1ad-51e0afb116aa None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:56.545728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 716/1471] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:56.550999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c77b-b90e-4f19-929d-c466e7968c64 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:56.551412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c77b-b90e-4f19-929d-c466e7968c64 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:56.551551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c77b-b90e-4f19-929d-c466e7968c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:56.570050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-93c4c77b-b90e-4f19-929d-c466e7968c64 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:56.571242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-93c4c77b-b90e-4f19-929d-c466e7968c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:56.579549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 756/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:56.626277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b17e-4b54-46ef-a165-8ccffc9bff8d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:56.626576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b17e-4b54-46ef-a165-8ccffc9bff8d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:56.626854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b17e-4b54-46ef-a165-8ccffc9bff8d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:56.628220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 717/1473] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 17 08:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:56.632864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980521-658a-4161-a8a5-70106efd3b05 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:56.633153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980521-658a-4161-a8a5-70106efd3b05 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:56.633428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980521-658a-4161-a8a5-70106efd3b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:56.652316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-af980521-658a-4161-a8a5-70106efd3b05 None None] MFA Rules not processed for user `abab3be86e7f48ad8cfc406f4c6c988d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:56.653551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-af980521-658a-4161-a8a5-70106efd3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:56.660187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 757/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 17 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:56.667382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7b17e-4b54-46ef-a165-8ccffc9bff8d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:56.678306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7b17e-4b54-46ef-a165-8ccffc9bff8d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:56.681782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:56.682404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:56.682685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:56.682954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:56.692170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:56.693661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b222d-d15c-424c-becb-d658690fda25 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:56.702801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 718/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:29:58.913137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31012d4-898d-4b86-b03d-a99185575050 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:58.913629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31012d4-898d-4b86-b03d-a99185575050 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:58.913744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31012d4-898d-4b86-b03d-a99185575050 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:58.915078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 758/1476] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:29:58.920129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da9c5-7242-419e-bdec-4ff83d4516e9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:58.920579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da9c5-7242-419e-bdec-4ff83d4516e9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:58.920719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da9c5-7242-419e-bdec-4ff83d4516e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:58.938911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a85da9c5-7242-419e-bdec-4ff83d4516e9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:29:58.940111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a85da9c5-7242-419e-bdec-4ff83d4516e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:29:58.947875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 719/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:29:58.972008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31012d4-898d-4b86-b03d-a99185575050 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:29:58.984400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31012d4-898d-4b86-b03d-a99185575050 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:29:58.989871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:29:58.990509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:29:58.990786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:29:58.991056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:29:58.991781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:29:58.993805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:29:58.993805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:29:58.993805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:29:58.994916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eae3ab-33a0-4af2-ada3-82492fbde1bb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:29:59.013718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 759/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 08:29:58 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:30:01.161079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3145a-5db6-4e51-95ce-831959f54b1d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:01.161631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3145a-5db6-4e51-95ce-831959f54b1d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:01.161631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3145a-5db6-4e51-95ce-831959f54b1d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:01.162923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 720/1479] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:30:01.168032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad42c9-9c7b-4830-8e21-a8c31fbbdfb5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:01.168519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad42c9-9c7b-4830-8e21-a8c31fbbdfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:01.168628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad42c9-9c7b-4830-8e21-a8c31fbbdfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:01.188863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0cad42c9-9c7b-4830-8e21-a8c31fbbdfb5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:30:01.190068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0cad42c9-9c7b-4830-8e21-a8c31fbbdfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:30:01.199066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 760/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:30:01.243580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3145a-5db6-4e51-95ce-831959f54b1d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:30:01.258147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3145a-5db6-4e51-95ce-831959f54b1d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:30:01.263520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:30:01.264149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:01.264430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:01.264745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:01.273204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:30:01.274827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07038cf-c3e1-4864-b507-54db62ab045f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:30:01.284841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 721/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:30:03.685710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95fe5-aaeb-44a0-9acb-3d4c07c73174 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:03.686270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95fe5-aaeb-44a0-9acb-3d4c07c73174 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:03.686270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95fe5-aaeb-44a0-9acb-3d4c07c73174 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:03.687629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 761/1482] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:30:03.693569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45d834-f19f-46b2-b0bb-9521215543b1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:03.693999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45d834-f19f-46b2-b0bb-9521215543b1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:03.694148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45d834-f19f-46b2-b0bb-9521215543b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:03.712052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3f45d834-f19f-46b2-b0bb-9521215543b1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:30:03.713272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3f45d834-f19f-46b2-b0bb-9521215543b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:30:03.721140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 722/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:30:03.757541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95fe5-aaeb-44a0-9acb-3d4c07c73174 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:30:03.768269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95fe5-aaeb-44a0-9acb-3d4c07c73174 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:30:03.771783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:30:03.772420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:03.772734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:03.773010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:03.781789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:30:03.783213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49341-9944-4cfd-bea4-40c235e17e51 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:30:03.792473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 762/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:30:05.961121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928628cd-b2cd-42fb-ab4a-b7bd739fd8b9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:05.961653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928628cd-b2cd-42fb-ab4a-b7bd739fd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:05.961653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928628cd-b2cd-42fb-ab4a-b7bd739fd8b9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:05.963023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 723/1485] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:30:05.968107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eca1-9fd0-464f-9d98-12fce076ec17 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:05.968524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eca1-9fd0-464f-9d98-12fce076ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:05.968688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eca1-9fd0-464f-9d98-12fce076ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:05.987714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7809eca1-9fd0-464f-9d98-12fce076ec17 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:30:05.988940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7809eca1-9fd0-464f-9d98-12fce076ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:30:05.999182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 763/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:30:06.034761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928628cd-b2cd-42fb-ab4a-b7bd739fd8b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:30:06.045347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928628cd-b2cd-42fb-ab4a-b7bd739fd8b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:30:06.049683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a29d3-1446-4669-9895-64857259177f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:30:06.050318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a29d3-1446-4669-9895-64857259177f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:06.050598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a29d3-1446-4669-9895-64857259177f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:06.050872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a29d3-1446-4669-9895-64857259177f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:06.059685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a29d3-1446-4669-9895-64857259177f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:30:06.061137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a29d3-1446-4669-9895-64857259177f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:30:06.071153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 724/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:30:08.380800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12f32-cd7a-4fe2-9c51-ffa5a7d94feb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:08.381347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12f32-cd7a-4fe2-9c51-ffa5a7d94feb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:08.381347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12f32-cd7a-4fe2-9c51-ffa5a7d94feb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:08.382759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 764/1488] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:30:08.388065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb950-2032-4c96-91d8-c33948d7f857 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:08.388555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb950-2032-4c96-91d8-c33948d7f857 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:08.388669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb950-2032-4c96-91d8-c33948d7f857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:08.407311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-466eb950-2032-4c96-91d8-c33948d7f857 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:30:08.408507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-466eb950-2032-4c96-91d8-c33948d7f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:30:08.416695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 725/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:30:08.457235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12f32-cd7a-4fe2-9c51-ffa5a7d94feb None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:30:08.467910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12f32-cd7a-4fe2-9c51-ffa5a7d94feb None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:30:08.472002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:30:08.472680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:08.472964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:08.473239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:08.482066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:30:08.483528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624966d-969c-485b-940b-e567544b7234 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:30:08.493170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 765/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:30:11.070578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146575-62e7-4ba1-b3a7-6b111a010aeb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:11.071137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146575-62e7-4ba1-b3a7-6b111a010aeb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:11.071137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146575-62e7-4ba1-b3a7-6b111a010aeb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:11.072518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 726/1491] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 08:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:30:11.077595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3dec-e43e-4d65-8035-c3d273191654 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:11.078755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3dec-e43e-4d65-8035-c3d273191654 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:11.079226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d3dec-e43e-4d65-8035-c3d273191654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:11.096897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0b8d3dec-e43e-4d65-8035-c3d273191654 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:30:11.098067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0b8d3dec-e43e-4d65-8035-c3d273191654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:30:11.105660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 766/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 08:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:30:11.145371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146575-62e7-4ba1-b3a7-6b111a010aeb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:30:11.155993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146575-62e7-4ba1-b3a7-6b111a010aeb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:30:11.159643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:30:11.160276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:30:11.160612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:30:11.160890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:30:11.169709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:30:11.171139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f932-f903-4317-a371-6d39ec608a0e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:30:11.180949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 727/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:30:21.091578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=33 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:30:21.176896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=33 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:48.246254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.246826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.246826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.265178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:48.266358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:48.274009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 767/1494] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:31:48.283335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.283812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.283912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.301582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:48.302778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:48.311083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 728/1495] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:31:48.315482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.325807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3004-c247-4dcb-a970-bd5311e1c11e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.330178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.330825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.331109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.331376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.332083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:48.332382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.333414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.333414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:31:48.333414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:31:48.334285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.346030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 768/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:48.353911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.362846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928043f6-eefb-4b4e-bc0a-ef52bb8cd724 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.367600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.368244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.369101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.369361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.370054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.371817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.371817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:31:48.371817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:31:48.373050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.513571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 729/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:31:48.519546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.530526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9ffc-8a88-409d-be02-1b240b129f5c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.586224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.586900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.587762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.588045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.588866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.589879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.589879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:31:48.589879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:31:48.591097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.665744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 769/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:31:48.671452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.685510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d96a-f223-4834-9eeb-d33277012cda admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.690308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.691007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.691288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.691560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.692292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.693350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.693350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:31:48.693350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:31:48.694242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.709659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 730/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:31:48.714842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.725369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98406-0408-47bf-8f67-541efa821384 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.730294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.730991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.731275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.731552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.732969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.734109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.734109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:31:48.734109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:31:48.734999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954e877-f2ba-44a3-809b-7058db87185b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.750654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 770/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:31:48.755917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:48.766719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8693b8-bf60-4f2c-aa00-d6a29c1aac44 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:48.772126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:48.778079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.778079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.778079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] PATH_INFO: `/v3/projects/194df259a27e4d8c882134bc12f19800/users/25f1c122f392434bb04b6f597beb3f28/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.794636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194df259a27e4d8c882134bc12f19800, user_id=25f1c122f392434bb04b6f597beb3f28, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:48.795744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:48.795744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:31:48.795744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:31:48.797737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97999-ed91-49e8-96a9-dd5fb2ab2fd7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:48.952728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 731/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:31:48 2022] PUT /identity/v3/projects/194df259a27e4d8c882134bc12f19800/users/25f1c122f392434bb04b6f597beb3f28/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:31:48.964273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f8f-cad8-45c0-b20d-8b85c179bd32 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.974829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f8f-cad8-45c0-b20d-8b85c179bd32 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.974829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f8f-cad8-45c0-b20d-8b85c179bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.997463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b0955f8f-cad8-45c0-b20d-8b85c179bd32 None None] MFA Rules not processed for user `25f1c122f392434bb04b6f597beb3f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:48.999746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b0955f8f-cad8-45c0-b20d-8b85c179bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:49.082408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 771/1502] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:31:49.101813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff29b-e8b1-4166-b2ff-f2b9abdfbc59 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.102864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff29b-e8b1-4166-b2ff-f2b9abdfbc59 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.102864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff29b-e8b1-4166-b2ff-f2b9abdfbc59 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.105352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 732/1503] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 17 08:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:49.110953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da34b6-eb1a-4df9-863a-9310d78a719b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.111242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da34b6-eb1a-4df9-863a-9310d78a719b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.111535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da34b6-eb1a-4df9-863a-9310d78a719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.136684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-23da34b6-eb1a-4df9-863a-9310d78a719b None None] MFA Rules not processed for user `8ec5d01659b2451fbbd9e2d5647b9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:49.138497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-23da34b6-eb1a-4df9-863a-9310d78a719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:49.233985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:49.241822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 772/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 17 08:31:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:31:49.251132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff29b-e8b1-4166-b2ff-f2b9abdfbc59 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:49.265246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff29b-e8b1-4166-b2ff-f2b9abdfbc59 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:49.268850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:49.269491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.269767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.270039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.281383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:49.283475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:49.294999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 733/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:31:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:31:49.341424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bcfd5-25f2-4a13-84cb-4f1a4356bf70 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.341861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bcfd5-25f2-4a13-84cb-4f1a4356bf70 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.341960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bcfd5-25f2-4a13-84cb-4f1a4356bf70 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.343241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 773/1506] 10.222.0.48 () {52 vars in 829 bytes} [Fri Jun 17 08:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:49.347155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:49.408905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136461e1-2606-4650-885e-1f360244f16e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:49.413407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:49.414277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.414561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.414852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] PATH_INFO: `/v3/users/25f1c122f392434bb04b6f597beb3f28` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.416583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f1c122f392434bb04b6f597beb3f28)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:49.417603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:49.417603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:31:49.417603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:31:49.418866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:49.606553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f1c122f392434bb04b6f597beb3f28'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:49.607187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f1c122f392434bb04b6f597beb3f28'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:49.607912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f1c122f392434bb04b6f597beb3f28'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:49.630359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f1c122f392434bb04b6f597beb3f28'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:49.645681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f1c122f392434bb04b6f597beb3f28'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:49.651379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:49.767560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 734/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:31:49 2022] DELETE /identity/v3/users/25f1c122f392434bb04b6f597beb3f28 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:31:49.772027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.772318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.772620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.791124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:49.792329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:49.849942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 774/1508] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:31:49.861151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:49.862545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:49.943002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadde5db-f99d-405b-9d07-40ea53c1dfb4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:49.947278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:49.947942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.948282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.948516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.957761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:49.959184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62978f-e9ad-4f51-b4ca-60782c2191ba service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:49.969664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 735/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:31:50.500555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:50.502060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:50.514019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d669-86a3-47c4-bd21-250acb69b1ca None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:50.518583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:50.519447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:50.519728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:50.520000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] PATH_INFO: `/v3/projects/194df259a27e4d8c882134bc12f19800` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:50.521199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194df259a27e4d8c882134bc12f19800)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:50.522267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:31:50.522267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:31:50.522267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:31:50.523467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:50.670405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194df259a27e4d8c882134bc12f19800', 'request_id': 'req-44eb8f03-b2c4-4f13-9762-88110be65b27'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:50.684345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194df259a27e4d8c882134bc12f19800', 'request_id': 'req-44eb8f03-b2c4-4f13-9762-88110be65b27'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:50.755791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194df259a27e4d8c882134bc12f19800', 'request_id': 'req-44eb8f03-b2c4-4f13-9762-88110be65b27'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:50.767296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] The token cache is being invalidate because project 194df259a27e4d8c882134bc12f19800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:31:50.768254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:50.768254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-44eb8f03-b2c4-4f13-9762-88110be65b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:31:50.769846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 775/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:31:50 2022] DELETE /identity/v3/projects/194df259a27e4d8c882134bc12f19800 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:31:59.973066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:00.764206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.590267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.590907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.590907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.592206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 736/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:32.597751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa261e-257a-466e-866f-9c33de83585f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.598200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa261e-257a-466e-866f-9c33de83585f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.598304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa261e-257a-466e-866f-9c33de83585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.617305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-72aa261e-257a-466e-866f-9c33de83585f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:32.618787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-72aa261e-257a-466e-866f-9c33de83585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:32.676332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 776/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:33:32.852552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.854245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:32.930546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9d9a5-e007-4e92-ad27-0150ba91103f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.936065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.936770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.937050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.937325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.945929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.947516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6a036-a47b-44fe-8220-d55c9a5357ef service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.957478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 737/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:33.848691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702194c-d6d8-440a-b3ae-66850749fd6a None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.849231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702194c-d6d8-440a-b3ae-66850749fd6a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.849231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702194c-d6d8-440a-b3ae-66850749fd6a None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.850612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 777/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:33.855360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6fe8-3625-43d5-830c-99b7a717920e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.855756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6fe8-3625-43d5-830c-99b7a717920e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.855918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6fe8-3625-43d5-830c-99b7a717920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.873992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-02cb6fe8-3625-43d5-830c-99b7a717920e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:33.875224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-02cb6fe8-3625-43d5-830c-99b7a717920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:33.883236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 738/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:34.037784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702194c-d6d8-440a-b3ae-66850749fd6a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.052654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702194c-d6d8-440a-b3ae-66850749fd6a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.058045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.058685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.058976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.059255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.068040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.069666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30dafc-65e6-4536-9779-d8ca76cb6f37 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.078984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 778/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:36.838132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981384-95ca-484b-af9a-96f3aaeb7353 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.838689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981384-95ca-484b-af9a-96f3aaeb7353 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.838796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981384-95ca-484b-af9a-96f3aaeb7353 None None] PATH_INFO: `/v3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.840180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 739/1517] 10.222.0.75 () {54 vars in 925 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.848824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351e26-e3d6-4281-bee7-6b044c987787 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.849250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351e26-e3d6-4281-bee7-6b044c987787 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.849376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351e26-e3d6-4281-bee7-6b044c987787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.868566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d8351e26-e3d6-4281-bee7-6b044c987787 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:36.869853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d8351e26-e3d6-4281-bee7-6b044c987787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:36.935284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 779/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Fri Jun 17 08:33:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:41.269157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d36dd-244f-4445-b8cc-02e6366e8340 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.269677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d36dd-244f-4445-b8cc-02e6366e8340 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.269677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d36dd-244f-4445-b8cc-02e6366e8340 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.270979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 740/1519] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 17 08:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:41.275906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1342-f76c-4bab-b641-676502792c33 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.276330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1342-f76c-4bab-b641-676502792c33 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.276467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1342-f76c-4bab-b641-676502792c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.294335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6c8b1342-f76c-4bab-b641-676502792c33 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:41.295533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6c8b1342-f76c-4bab-b641-676502792c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:41.304777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 780/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 17 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:41.312085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d36dd-244f-4445-b8cc-02e6366e8340 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.325829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d36dd-244f-4445-b8cc-02e6366e8340 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.331429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.332056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.332333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.332675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.340859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.342439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b603-b4e0-47ed-b7f4-89eaa493a716 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.352212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 741/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:45.380666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052623-2fa0-467b-86eb-1a7bf4a4c39a None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.381219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052623-2fa0-467b-86eb-1a7bf4a4c39a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.381219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052623-2fa0-467b-86eb-1a7bf4a4c39a None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.382585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 781/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:45.387526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e5f0-df6e-41df-91e1-26b5fad6e109 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.387952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e5f0-df6e-41df-91e1-26b5fad6e109 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.388086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e5f0-df6e-41df-91e1-26b5fad6e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.406456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-33f8e5f0-df6e-41df-91e1-26b5fad6e109 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:45.407637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33f8e5f0-df6e-41df-91e1-26b5fad6e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:45.415925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 742/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:45.582687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052623-2fa0-467b-86eb-1a7bf4a4c39a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.596866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052623-2fa0-467b-86eb-1a7bf4a4c39a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.602262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.602901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.603182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.603458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.611422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.614019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b195db-322f-436e-a5b3-b09f2c3f8683 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.623476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 782/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:46.505287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa75-aba4-4158-8c24-9788d0d1afdc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.505870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa75-aba4-4158-8c24-9788d0d1afdc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.505870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa75-aba4-4158-8c24-9788d0d1afdc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.507279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 743/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:46.512048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dade2-a22a-4c58-819f-8bcab404b886 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.512467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dade2-a22a-4c58-819f-8bcab404b886 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.512716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dade2-a22a-4c58-819f-8bcab404b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.532512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8d2dade2-a22a-4c58-819f-8bcab404b886 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:46.533808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8d2dade2-a22a-4c58-819f-8bcab404b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:46.541576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 783/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:46.702784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeaa75-aba4-4158-8c24-9788d0d1afdc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.717654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeaa75-aba4-4158-8c24-9788d0d1afdc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.723415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.724051 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.724356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.724633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.737113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.740172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faa5a7-9321-4534-88c6-b4d1c83b4b77 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.750515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 744/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:50.939046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.940127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.940127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.941669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 784/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:50.946743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5adc40-439d-4d2a-b36e-5149c58a071c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.947139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5adc40-439d-4d2a-b36e-5149c58a071c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.947277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5adc40-439d-4d2a-b36e-5149c58a071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.964760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5f5adc40-439d-4d2a-b36e-5149c58a071c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:50.965933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f5adc40-439d-4d2a-b36e-5149c58a071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:50.974307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 745/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:51.011200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.012991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:51.070388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9ea3-baeb-4283-93f9-c1e17f8367e0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.073930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.074571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.074855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.075133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.084009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.085467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df5cc-2dc8-4b68-b74d-58f8c8563b34 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.090327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:51.094919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 785/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:53.309235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.309777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.309777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.311173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 746/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:53.316870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c8a4-16de-420a-8d9b-e15ef3b4eaf0 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.317315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c8a4-16de-420a-8d9b-e15ef3b4eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.317420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c8a4-16de-420a-8d9b-e15ef3b4eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.335927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c624c8a4-16de-420a-8d9b-e15ef3b4eaf0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:53.337150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c624c8a4-16de-420a-8d9b-e15ef3b4eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:53.344824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 786/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:33:53.383941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:53.385640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:53.399304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b14b13-15d2-48f8-b51b-65223102fb7c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.402813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.403446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.403727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.404004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.413291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.414720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3cf7-e24c-40c0-98eb-631fd66a0f43 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.424949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 747/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:57.198505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.199120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.199120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.200604 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 787/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:57.205804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc60cc-bb26-482b-83a0-db7af0b876b6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.206207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc60cc-bb26-482b-83a0-db7af0b876b6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.206351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc60cc-bb26-482b-83a0-db7af0b876b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.224406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e6bc60cc-bb26-482b-83a0-db7af0b876b6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:57.225610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6bc60cc-bb26-482b-83a0-db7af0b876b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:57.233644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 748/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:33:57.500013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:57.501857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:57.558474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d7f3-edc1-43e8-b6df-964de2c43135 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:57.562083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:57.562726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.563011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.563284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.572361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:57.573829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4877edb-bf12-4568-9d83-530c5864e6b6 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:57.583789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 788/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:33:59.751358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.752175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.752175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.753647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 749/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:59.758772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4443-db06-4a9d-97b2-c405ee18865c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.759159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4443-db06-4a9d-97b2-c405ee18865c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.759350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4443-db06-4a9d-97b2-c405ee18865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.777562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6f1d4443-db06-4a9d-97b2-c405ee18865c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:59.778739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6f1d4443-db06-4a9d-97b2-c405ee18865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:59.787151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 789/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:34:00.053734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.056049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:00.063131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=65 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.068897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907e1a0-044f-4682-a90b-05bb6fcefbaa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.072521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.073152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.073432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.073708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.082806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.084237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16072e7-1334-401e-8049-1bef2a041cb0 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.093464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 750/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:34:09.772433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=32 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:10.149613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:30.333484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530303af-bd4d-44ef-b143-b3895cec6d9c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.334618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530303af-bd4d-44ef-b143-b3895cec6d9c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.335150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530303af-bd4d-44ef-b143-b3895cec6d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.361797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-530303af-bd4d-44ef-b143-b3895cec6d9c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.363496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-530303af-bd4d-44ef-b143-b3895cec6d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.372822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 790/1540] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.382932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c7c1-4282-4aa0-a234-69c2395bfbff None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.383913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c7c1-4282-4aa0-a234-69c2395bfbff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.384402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c7c1-4282-4aa0-a234-69c2395bfbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.406764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.407547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.408054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.412477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6f01c7c1-4282-4aa0-a234-69c2395bfbff None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.412477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6f01c7c1-4282-4aa0-a234-69c2395bfbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.428943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 751/1541] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.430687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3e2b-26db-418d-8a3d-c87fbd37ae35 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.430834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3e2b-26db-418d-8a3d-c87fbd37ae35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.431111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3e2b-26db-418d-8a3d-c87fbd37ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.437602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.438778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.455797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 791/1542] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:30.457548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.458452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d70d3e2b-26db-418d-8a3d-c87fbd37ae35 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.460154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d70d3e2b-26db-418d-8a3d-c87fbd37ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.478640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7803c-a4bd-425e-a2a4-2b8ad0043def None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.482311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 752/1543] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.483619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abafa-ba61-4d1c-98e4-e783c002b388 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.484393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abafa-ba61-4d1c-98e4-e783c002b388 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.484702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abafa-ba61-4d1c-98e4-e783c002b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.493099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.494841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.495134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.495416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.496160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:30.496472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.499454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d919-8fe0-4719-b167-fc523140f131 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.516439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b81abafa-ba61-4d1c-98e4-e783c002b388 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.517750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b81abafa-ba61-4d1c-98e4-e783c002b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.520090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 792/1544] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:30.521810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f04b3-7162-4f73-85b5-ab45cc9f2295 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.522093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f04b3-7162-4f73-85b5-ab45cc9f2295 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.522367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f04b3-7162-4f73-85b5-ab45cc9f2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.531513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 753/1545] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.532832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142d77-2d39-4ad7-b70d-fa0be289ca91 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.533126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142d77-2d39-4ad7-b70d-fa0be289ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.533394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142d77-2d39-4ad7-b70d-fa0be289ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.542970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2d1f04b3-7162-4f73-85b5-ab45cc9f2295 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.544231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2d1f04b3-7162-4f73-85b5-ab45cc9f2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.551074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-13142d77-2d39-4ad7-b70d-fa0be289ca91 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.552239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-13142d77-2d39-4ad7-b70d-fa0be289ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.552835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 793/1546] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.554104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cda58-b80d-4cf0-b2c7-b30629287569 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.554393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cda58-b80d-4cf0-b2c7-b30629287569 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.554707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cda58-b80d-4cf0-b2c7-b30629287569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.562652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 754/1547] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.564062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56e3b-23d7-4c44-9022-58c591a8c0e8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.564348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56e3b-23d7-4c44-9022-58c591a8c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.564668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56e3b-23d7-4c44-9022-58c591a8c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.574714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-319cda58-b80d-4cf0-b2c7-b30629287569 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.575944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-319cda58-b80d-4cf0-b2c7-b30629287569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.584068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-45b56e3b-23d7-4c44-9022-58c591a8c0e8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.584471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 794/1548] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.585211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45b56e3b-23d7-4c44-9022-58c591a8c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.586769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.587173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.587458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.593266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 755/1549] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.594478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.594765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.595041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.606566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.607785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.612914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.614108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.617048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 795/1550] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.617643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.622554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 756/1551] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.623358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.632219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86728263-7298-4526-9d2f-6a15e5bd1880 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.633274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986a7a2-92b4-4b2d-8d51-34676bbe638d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.637147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.637815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.637917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.638100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.638375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.638541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.638823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.639097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.639201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.639884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:30.640131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.640236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:30.640236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:35:30.640236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:35:30.647704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:30.647704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:35:30.647704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:35:30.648038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9f1d-f5e6-4a5d-96b9-b8be9fbdd1f0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.648136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16b43f-2007-4517-9ac2-26ecfe540f25 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.654372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 757/1552] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:30.655616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.655904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.656181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.673872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.675736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.683514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 758/1553] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.684275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.693395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bcf36-529a-4b10-a377-c44fbb9d48c5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.704981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.704981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.704981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.704981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.705385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:30.705385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.705385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0225c-1541-4e3c-a237-b256bdf79636 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.712947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 759/1554] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:30.714169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc625f-c9ce-4fe7-a618-126828aaeade None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.714455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc625f-c9ce-4fe7-a618-126828aaeade None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.714728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc625f-c9ce-4fe7-a618-126828aaeade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.732740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-11bc625f-c9ce-4fe7-a618-126828aaeade None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.733926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11bc625f-c9ce-4fe7-a618-126828aaeade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.742729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 760/1555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.743976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.744264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.744562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.801315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 796/1556] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:30.802795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6777a-0616-4ec2-96ed-57af8d8417db None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.803088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6777a-0616-4ec2-96ed-57af8d8417db None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.803369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6777a-0616-4ec2-96ed-57af8d8417db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.825882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-deb6777a-0616-4ec2-96ed-57af8d8417db None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.827126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-deb6777a-0616-4ec2-96ed-57af8d8417db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.881653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.882783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.890938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 797/1557] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.892235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.892546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.892827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.916657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:30.917914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:30.925868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 798/1558] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.926615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.935926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860742-27d2-4f46-af4d-bb1300eadb5a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.940705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.941498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.941782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.942054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.942740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.944655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.949815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 761/1559] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:30.953408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.960657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e9bc-2099-493c-b6e4-03aac03d9fb1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.965158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.965802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.966083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.966356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.967131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:30.967433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:30.969087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:30.981180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 762/1560] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:30.982058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:30.992579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7347-1798-48dc-92e3-084ace8bfd56 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:30.997301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:30.997934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:30.998215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:30.998489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:30.999166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.001087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.090225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 799/1561] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.091143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.152550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14d7f-484f-4800-9d00-94619c934c00 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.157109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.157769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.158053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.158327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.159087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:31.159427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.161034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.167549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:31.173264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 800/1562] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:31.174005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.183468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 763/1563] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:30 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.191792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.191935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac935-9976-40cc-96f7-620e7dabccc1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.232054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:31.243612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.244289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.244596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.244869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.245549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.246784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978b9b-c3b0-4118-9415-b842eb219892 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.247469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.251613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.252272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.252588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.253613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.254445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:31.254751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.256346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.268250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 764/1564] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:31.269282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.278817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680770-7fd4-4490-8887-cf5659db5e56 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.283320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.284516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.284875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.285155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.285864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:31.286168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.287738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.299224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 765/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:31.300678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.309877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8ad6-dfd6-4236-b24f-6f53cd0353ad admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.314365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.315032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.315380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.315663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.316371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:31.316719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.319137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.333038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 766/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:31.333843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.343190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6baab2-e87a-4896-a220-8e4e7c818b7c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.349614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.350331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.350617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.351122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.351889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.354830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.380806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 801/1567] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.383188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.391078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479356-237a-4756-9a0a-2fbfbc65bd21 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.395625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.396315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.396642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.396921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.397595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.399501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.473668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 767/1568] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.474554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.509303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 802/1569] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.509303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.519460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a6e6-4731-4d73-b43d-5d5fde069ea3 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.537892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3fe51-b46a-4a8f-8ee8-25734dae2db3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.542863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.543539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.543822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.544102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.544884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.546810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.583071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.583757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.584042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.584317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.585481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.587431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.633090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 768/1570] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.633907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.649822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 803/1571] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.650655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.662515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591297b4-2ff0-42ed-9f6e-9c90967b865c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.698210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2b970-02ea-4db9-9cef-1f3a025a7878 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.702818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.703475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.704019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.704019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.704753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.707269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.719991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.720688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.720981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.721289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.722737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.724776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.728028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:31.770380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 769/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.771357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.775665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:31.811333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 804/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.814565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.834500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba862-0148-4e09-84e8-62bdf5d05edd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.873388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf18b1-479a-4d3f-a428-188fb75f61f4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.878763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.879571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.879849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.880127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.880882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.882496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.890240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.890894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.891171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.891440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.892118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.892291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 805/1574] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:31.893830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.895134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.910348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3644f-9ba8-4833-ad08-f18f8d6ca9b5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:31.913050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:31.913729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:31.914010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:31.914283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:31.914965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:31.917005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:31.987778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 770/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.988599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:31.996541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 806/1576] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:31.997720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.009782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e46b-1fe3-4289-96c4-37bddc794ce6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.054011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc431ffb-95ff-414a-bc84-3d1aeaccb1b8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.058729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.059405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.059687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.059959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.060756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.062546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.067422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.068099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.068377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.068789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.069480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.071419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.073135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 771/1577] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.073936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.084593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfdc58-ab02-4c97-9f67-27e7f859e3d8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.089124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.089761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.090069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.090340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.091050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.092662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.103290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 772/1578] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.104060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.114442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c7d16-aba5-4f33-a130-3230ee20a606 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.119041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.119666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.119975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.120252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.120957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.121936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:32.121936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:35:32.121936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:35:32.123136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.184967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 807/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:31 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:32.185780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.195260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95b605-8f58-481f-be42-7a00283d4b32 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.199854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.200512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.200809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.201089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.201769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.203696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.215173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 773/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:32.216000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.220889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:32.226605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370eb68-f220-46c9-bbfa-da532a43ea61 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.231314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.231949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.232232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.232532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.233256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.234834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.245676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 774/1581] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.246372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.255814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46c6f-787c-4455-b7ab-a87144017865 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.260347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.260988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.261271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.261543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.262211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.264072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.314670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 808/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:32.314670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.322348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08754b94-735a-474f-a6cc-7f394f577cee admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.326947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.327593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.327881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.328162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.328925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.330512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.340398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 809/1583] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.341639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.351615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95aa13-af32-438d-8cf2-2e483e1d80e1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.356221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.356922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.357153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.357432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.358133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.359712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.368331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 775/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:32.368331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.374544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 810/1585] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.375266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.375519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1743-0865-48c8-895b-7455a93d2913 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.381528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.382184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.382469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.382743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.383475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.385113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.387250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a85e-68a1-4854-b88b-e51daa00d54b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.391869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.392525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.392816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.393094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.394353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.395997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.396782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 776/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.397348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.406794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604d3e-b3c7-4fee-ab4e-f6043a05a75b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.409821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 811/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.410674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.412746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.413491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.413799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.414081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.414813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.415800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:32.416414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.421036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbdf0-f9f1-4759-845c-7b10f324ea7a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.425914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.426584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 777/1588] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.426783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.427068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.427232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.427348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] PATH_INFO: `/v3/projects/c8166c0f90124dac9d758720686535e9/users/a9cef287aa974448b3abef26a8018f03/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.436811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942105-5f66-45c4-ba7f-37bd4d81938d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.442043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.442705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.442808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8166c0f90124dac9d758720686535e9, user_id=a9cef287aa974448b3abef26a8018f03, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.442986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.443283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.443818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:32.443818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:35:32.443818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:35:32.444097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.445759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.445889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.456444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 778/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.457577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.468301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4271a1-dbf8-4bab-9fc1-88569d5d06f1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.473794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.474459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.474735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.475005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.475756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.477386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.487318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 779/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.488220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.497467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc53fb4-4087-4d2d-a3ae-2ab89e0ae570 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.502179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.502856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.503233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.503509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.504203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.505832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.516191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 780/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.516973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.526808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6eabd-b9be-4d8f-bc3b-ad7ac8d480b8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.531337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.532169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.532448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.532756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] PATH_INFO: `/v3/projects/5dacb56069b74ca6b04d4710a9c4bc96/users/af32d2a5a83546699f5e2caa3def410d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.547323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dacb56069b74ca6b04d4710a9c4bc96, user_id=af32d2a5a83546699f5e2caa3def410d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.550323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.554639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 812/1592] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:32 2022] PUT /identity/v3/projects/c8166c0f90124dac9d758720686535e9/users/a9cef287aa974448b3abef26a8018f03/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:32.554639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.617298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4f02-328c-4579-91b6-ce02cfbbdfb5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.623962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.624888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.625169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.625444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] PATH_INFO: `/v3/projects/9398f73795f54f46b21bfcecbfd9c980/users/fe87a25072b04f9890e1aab97d6a40ef/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.638452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 781/1593] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:32 2022] PUT /identity/v3/projects/5dacb56069b74ca6b04d4710a9c4bc96/users/af32d2a5a83546699f5e2caa3def410d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:32.643931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.646173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9398f73795f54f46b21bfcecbfd9c980, user_id=fe87a25072b04f9890e1aab97d6a40ef, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.649673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.701003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26def180-5117-4879-996a-ad86f2a3b69e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.706350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.707131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.707415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.707693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.708443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.710114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.717779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 813/1594] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:32 2022] PUT /identity/v3/projects/9398f73795f54f46b21bfcecbfd9c980/users/fe87a25072b04f9890e1aab97d6a40ef/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:32.718741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.724673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 782/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.725646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.738761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fd115-8f49-4e57-85d2-2fb875b771b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.784774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:32.788762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8636f-0243-4cb9-9fd2-d3a66632e908 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.793465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.799621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.799808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.799989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.799989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.800318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.800318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.800559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.800673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.800673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.800875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.800977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.807101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 814/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.807898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.809659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 783/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.810718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.821924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e457-573e-4f36-8d81-20aeb12cbf9b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.822795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107c39-4ae1-4264-8e1d-05ae99dc22a6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.826816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.828035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.828194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.828194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.828418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.828418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.828632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] PATH_INFO: `/v3/projects/f3dcb2b032ea4e239280dffbfce4e6e1/users/fd2a9fbd67524399945fe3e698def518/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.828762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.829490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.831837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20a14a-5ee7-4f2c-b477-5cb3107f9856 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.842439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 784/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:32.844040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3dcb2b032ea4e239280dffbfce4e6e1, user_id=fd2a9fbd67524399945fe3e698def518, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:32.846048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12812-e0c8-4eea-ab9f-e9cdf680a8ee None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.846374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12812-e0c8-4eea-ab9f-e9cdf680a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.846928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e9198-7a69-44b9-90f9-597fbc52c521 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:32.847185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12812-e0c8-4eea-ab9f-e9cdf680a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.864207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-afe12812-e0c8-4eea-ab9f-e9cdf680a8ee None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:32.865442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-afe12812-e0c8-4eea-ab9f-e9cdf680a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:32.873204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 785/1599] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:32.874448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.874850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.875093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.893080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:32.894942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:32.903064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 786/1600] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:32.905577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:32.915704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 815/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:32 2022] PUT /identity/v3/projects/f3dcb2b032ea4e239280dffbfce4e6e1/users/fd2a9fbd67524399945fe3e698def518/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:32.917317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.917699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.918047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:32.924056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347419e-ec4d-4fa3-9ff7-fc4f709728ea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:32.946718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] MFA Rules not processed for user `fe87a25072b04f9890e1aab97d6a40ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:32.947971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:32.978943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:32.982612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:32.983522 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:32.983812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:32.984083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] PATH_INFO: `/v3/projects/bf23aa46d9a34f5f99bcdebbe1d2662f/users/4317a4081cef445189ed4907789fae26/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.007281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf23aa46d9a34f5f99bcdebbe1d2662f, user_id=4317a4081cef445189ed4907789fae26, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.012018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.040114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 816/1602] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.040321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.051116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760954-e668-4108-aee5-84bb0af1a20e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.055838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.056765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.057519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.057519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] PATH_INFO: `/v3/projects/493f7f45114e4c95bfebaaf7295ba472/users/8d137ca8a35c463c8838dc92bfa300dc/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.073639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f7f45114e4c95bfebaaf7295ba472, user_id=8d137ca8a35c463c8838dc92bfa300dc, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.076305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.106412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 787/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:32 2022] PUT /identity/v3/projects/bf23aa46d9a34f5f99bcdebbe1d2662f/users/4317a4081cef445189ed4907789fae26/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:33.107245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.168207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d894c4-06b6-47a6-ad6f-563a643c5df1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.172865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.173741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.174021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.174290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] PATH_INFO: `/v3/projects/ae365d6da0e846baa0056cb67ac716d6/users/fb1df28c175c40b7a06d1f94ba780d28/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.188114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae365d6da0e846baa0056cb67ac716d6, user_id=fb1df28c175c40b7a06d1f94ba780d28, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.190811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.215220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 817/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:33 2022] PUT /identity/v3/projects/493f7f45114e4c95bfebaaf7295ba472/users/8d137ca8a35c463c8838dc92bfa300dc/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:33.216018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.276231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432fa8-5096-4e7d-ada0-775708be7a14 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.281067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.281962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.282244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.282516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] PATH_INFO: `/v3/projects/ac1fd5eb212b42ca9e20832c18e437dc/users/23dea673a3104094bd7869911f3ba85e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.303257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1fd5eb212b42ca9e20832c18e437dc, user_id=23dea673a3104094bd7869911f3ba85e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.306932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.317944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 788/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:33 2022] PUT /identity/v3/projects/ae365d6da0e846baa0056cb67ac716d6/users/fb1df28c175c40b7a06d1f94ba780d28/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:33.318889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.353365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.379524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776b0e-1d45-469f-aaea-a1cb9d27868e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.380867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 818/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:33 2022] PUT /identity/v3/projects/ac1fd5eb212b42ca9e20832c18e437dc/users/23dea673a3104094bd7869911f3ba85e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:33.384109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.435536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.436365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.436660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.436941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.441812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ec8a0-9200-4258-bcac-5c7e06d443e7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.445656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.446290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.446571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.446891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.482019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.500086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.501556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b12e6-f261-4016-8499-1d6d5cbab976 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.508951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.510535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308cdc3-8188-44bf-8bab-f4923450a958 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.512191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 789/1607] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:33.513655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082d71-c5a4-46f5-93db-23287b0be27f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.513945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082d71-c5a4-46f5-93db-23287b0be27f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.514219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082d71-c5a4-46f5-93db-23287b0be27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.522480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 819/1608] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:33.523696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a2c-0c6c-4d8d-87ff-eda86f21acfb None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.523992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a2c-0c6c-4d8d-87ff-eda86f21acfb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.524282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a2c-0c6c-4d8d-87ff-eda86f21acfb None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.525762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 820/1609] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 08:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:33.529042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ddf95-d40b-48cf-a061-b67c68a19271 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.529042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ddf95-d40b-48cf-a061-b67c68a19271 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.529042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ddf95-d40b-48cf-a061-b67c68a19271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.543274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ed082d71-c5a4-46f5-93db-23287b0be27f None None] MFA Rules not processed for user `fd2a9fbd67524399945fe3e698def518`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.544583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ed082d71-c5a4-46f5-93db-23287b0be27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.555198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7a0ddf95-d40b-48cf-a061-b67c68a19271 None None] MFA Rules not processed for user `4317a4081cef445189ed4907789fae26`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.557354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7a0ddf95-d40b-48cf-a061-b67c68a19271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.612850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 790/1610] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.614263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900eda-524b-4900-b3c4-3c73f886acc6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.614760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900eda-524b-4900-b3c4-3c73f886acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.615237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900eda-524b-4900-b3c4-3c73f886acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.644928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 821/1611] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.646254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8807b-58d7-4a75-a6b9-26443dbd2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.646545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8807b-58d7-4a75-a6b9-26443dbd2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.646919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8807b-58d7-4a75-a6b9-26443dbd2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.651296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-da900eda-524b-4900-b3c4-3c73f886acc6 None None] MFA Rules not processed for user `8d137ca8a35c463c8838dc92bfa300dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.652597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da900eda-524b-4900-b3c4-3c73f886acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.668053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-44f8807b-58d7-4a75-a6b9-26443dbd2ce3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.668567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.669516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-44f8807b-58d7-4a75-a6b9-26443dbd2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.680794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 822/1612] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.680794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.680794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.680794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.708900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] MFA Rules not processed for user `23dea673a3104094bd7869911f3ba85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.710390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.751920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 791/1613] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.751920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.751920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.751920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.772141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:33.773552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:33.818502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 823/1614] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.819357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.830843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232befc9-44f9-49ef-a097-5f597abf51c1 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.835470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.836158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.836439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.836742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.837439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.839342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.850451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 792/1615] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:33.851415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.911370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc289f0-3ac6-40e9-8c1f-75f90d42f88d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.915146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.915852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.916139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.916412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.926454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.927254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.937226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 793/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:33.938143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.949223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017464ee-d500-4656-b6c7-0b1b830c9539 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:33.953327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:33.954761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.954761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.954761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.966731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:33.968435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d779ca-d145-4786-8c3a-28c7b0cb0154 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:33.980169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 794/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:33.981474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac38d6-f5ab-41d2-9c5a-85b9e5f57390 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:33.983625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac38d6-f5ab-41d2-9c5a-85b9e5f57390 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:33.983625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac38d6-f5ab-41d2-9c5a-85b9e5f57390 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:33.983625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 795/1618] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 08:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:33.984012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac38d6-f5ab-41d2-9c5a-85b9e5f57390 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:33.997108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 824/1619] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:33.998618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.037135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:34.049213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:34.086989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac38d6-f5ab-41d2-9c5a-85b9e5f57390 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.091914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01e2f-cf0f-405c-8dcf-32e6ff58b79c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.092246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.094370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.094958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.095404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.096385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.098474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.101073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.101858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.102247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.102628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.167075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.168738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4048-e939-47b3-8d86-8bc1191da453 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.178674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 825/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:34.179977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.180254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.180549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.198228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:34.199461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:34.210330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 826/1621] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 08:35:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:34.210935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.222934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf346-9611-4bf2-b709-f344dcefd26b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.227765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.228446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.228757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.229034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.229877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.232049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.258215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 796/1622] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:33 2022] POST /identity/v3/projects => generated 405 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:34.259464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.392595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf1ef1-da32-43a7-acd9-2646c2fdadf0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.399913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.400521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.400807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.401079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.433688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 827/1623] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:34 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:34.433688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.491027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b85d-620e-45f9-966b-0c6d60b5ef50 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.491626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.493236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.506452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 797/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:34.509918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.626692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:34.631966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05e7f-2bf1-4484-9a38-9907f0c6f3ae service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.637362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.638349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.638678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.638963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.639704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.642070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.642218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624c1a6-1fb3-4400-aefc-7f31f206ebb1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.644582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.644899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.645176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.645883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.652992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519a07e-7767-4be8-9dca-e9af2b00f3df admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.657785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 798/1625] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:34.657785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66601f2-7291-4317-9e39-2964f9e6b413 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.657785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66601f2-7291-4317-9e39-2964f9e6b413 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.657785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66601f2-7291-4317-9e39-2964f9e6b413 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.659819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 799/1626] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 08:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:34.660582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66601f2-7291-4317-9e39-2964f9e6b413 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.676855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66601f2-7291-4317-9e39-2964f9e6b413 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.688400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.693767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.694061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.694398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] PATH_INFO: `/v3/projects/fd83c4769e994b5eb456903b7e82cba0/users/7feaf129c10747b8a8780404527f3893/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.715679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd83c4769e994b5eb456903b7e82cba0, user_id=7feaf129c10747b8a8780404527f3893, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.718514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.746438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 828/1627] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:34 2022] POST /identity/v3/users => generated 309 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:34.747823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.748174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.748643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.788377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:34.793110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:34.808506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 829/1628] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:35:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:34.809514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.833835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 800/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:34 2022] PUT /identity/v3/projects/fd83c4769e994b5eb456903b7e82cba0/users/7feaf129c10747b8a8780404527f3893/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:34.833835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:34.839260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92168e-69a3-4e64-94a0-e622750600a3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.873492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:34.932251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8342c-8b59-48dc-8759-aa868a761e90 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:34.936293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.936973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.937838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.937838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.967917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:34.968887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:34.969239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:34.970083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:34.976692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:34.978735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:34.996064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 830/1630] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:34.999908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.011120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee282c1-1796-41bd-b945-03a94c8339c7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.016226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.016944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.017228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.017508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.018407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.021009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3c703-f735-4d09-a87c-b72c6cae2276 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.043574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 831/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:35.043574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a523c6-6419-4e2c-a991-e5a0d31540fa None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.043574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a523c6-6419-4e2c-a991-e5a0d31540fa None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.043574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a523c6-6419-4e2c-a991-e5a0d31540fa None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.049076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 832/1632] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 08:35:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:35.050326 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a523c6-6419-4e2c-a991-e5a0d31540fa None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.064768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a523c6-6419-4e2c-a991-e5a0d31540fa None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.071315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.073821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.073821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.074017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.074143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] PATH_INFO: `/v3/projects/887919e8f7884377840ebad895071429/users/1a90e42bbf654242b1c01535f6773e74/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.074977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.090334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 801/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:35.091884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.119528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501e9c-2e33-47c4-90ec-104f7f87fe58 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.126441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.128900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.129442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.129930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] PATH_INFO: `/v3/projects/fd83c4769e994b5eb456903b7e82cba0/users/7feaf129c10747b8a8780404527f3893/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.132591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd83c4769e994b5eb456903b7e82cba0, user_id=7feaf129c10747b8a8780404527f3893, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.133727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887919e8f7884377840ebad895071429, user_id=1a90e42bbf654242b1c01535f6773e74, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.135976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91052d5f-fe32-479b-a499-950b8012332f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.137195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.162141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 802/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:35 2022] PUT /identity/v3/projects/fd83c4769e994b5eb456903b7e82cba0/users/7feaf129c10747b8a8780404527f3893/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:35.172376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef56c-95cd-4171-8157-fb5526a36b50 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.172376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef56c-95cd-4171-8157-fb5526a36b50 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.172376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef56c-95cd-4171-8157-fb5526a36b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.200025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9e9ef56c-95cd-4171-8157-fb5526a36b50 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:35.200025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9e9ef56c-95cd-4171-8157-fb5526a36b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:35.267843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:35.295020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 803/1635] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:35:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:35.296820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.297802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.302002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.317183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 833/1636] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:35 2022] PUT /identity/v3/projects/887919e8f7884377840ebad895071429/users/1a90e42bbf654242b1c01535f6773e74/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:35.320897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.339412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] MFA Rules not processed for user `7feaf129c10747b8a8780404527f3893`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:35.340366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:35.435841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1dad-2af8-4051-9294-e090e8c84af7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.443540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.444351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.444816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.445116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.465552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 804/1637] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:35.465552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.541741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90cd47-14ea-4155-ac7b-9a30fc8bab4c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.546992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.547704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.548041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.548321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.549770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.551759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.567506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 805/1638] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:35.571005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.571851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.574217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.587921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 834/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:35.603027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748372e-2eef-49ba-8617-7755dc64c98a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.617223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.623690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.623690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.623690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] PATH_INFO: `/v3/projects/887919e8f7884377840ebad895071429/users/1a90e42bbf654242b1c01535f6773e74/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.623690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=887919e8f7884377840ebad895071429, user_id=1a90e42bbf654242b1c01535f6773e74, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.644111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be46421-0a70-4ce0-b8af-65ab40d5e79d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.646945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:35.660170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8cc7-04ad-4e0b-b2ce-546db3b8b7c8 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:35.682806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 806/1640] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:35 2022] PUT /identity/v3/projects/887919e8f7884377840ebad895071429/users/1a90e42bbf654242b1c01535f6773e74/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:35.698903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.700400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.701357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.712805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:35.777075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] MFA Rules not processed for user `1a90e42bbf654242b1c01535f6773e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:35.778703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:35.781836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:35.782779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:35.783165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:35.784311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:35.851546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:35.879631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:35.881426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:35.905634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 807/1641] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:35.912397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 835/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:36.195774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:36.212627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc96ee6-48dc-4dba-8199-d4dad7626dde None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:36.219140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bf553-e034-4861-a771-00c819502597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:36.221950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf553-e034-4861-a771-00c819502597 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:36.222460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf553-e034-4861-a771-00c819502597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:36.222905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf553-e034-4861-a771-00c819502597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:36.237210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bf553-e034-4861-a771-00c819502597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:36.239145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bf553-e034-4861-a771-00c819502597 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:36.254016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 808/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:36 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:36.527241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:36.626523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bf553-e034-4861-a771-00c819502597 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:36.637461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bf553-e034-4861-a771-00c819502597 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:36.643074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:36.643811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:36.646476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:36.647508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:36.668362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2de323-0044-4931-bf14-9cb6dd8d3f65 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:36.685711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:36.687117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:36.687595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:36.688052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] PATH_INFO: `/v3/users/8d137ca8a35c463c8838dc92bfa300dc` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:36.691286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d137ca8a35c463c8838dc92bfa300dc)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:36.692726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: WARNING py.warnings [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:36.692726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: warnings.warn(msg) Jun 17 08:35:36.692726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: Jun 17 08:35:36.694356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:36.967284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:36.967284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:36.967284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 809/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:36.967284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:36.967284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9951e-3d00-4161-bbd4-74f48aecab7c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:36.994974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:36.994974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:36.994974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:36.994974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] PATH_INFO: `/v3/users/23dea673a3104094bd7869911f3ba85e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:36.996048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23dea673a3104094bd7869911f3ba85e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:36.996048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:37.109564 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d137ca8a35c463c8838dc92bfa300dc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.113147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d137ca8a35c463c8838dc92bfa300dc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.115270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d137ca8a35c463c8838dc92bfa300dc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.149755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d137ca8a35c463c8838dc92bfa300dc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.161375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:37.164035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c0ece467-5f8e-447f-b4f7-9730e64e1cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d137ca8a35c463c8838dc92bfa300dc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.296899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 836/1645] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:36 2022] DELETE /identity/v3/users/8d137ca8a35c463c8838dc92bfa300dc => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:37.303835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06002-badf-477b-ae81-843e7863b680 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:37.304194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06002-badf-477b-ae81-843e7863b680 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:37.304478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06002-badf-477b-ae81-843e7863b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:37.340057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-47a06002-badf-477b-ae81-843e7863b680 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:37.347982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-47a06002-badf-477b-ae81-843e7863b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:37.372399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23dea673a3104094bd7869911f3ba85e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.373145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23dea673a3104094bd7869911f3ba85e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.373942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23dea673a3104094bd7869911f3ba85e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.404205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23dea673a3104094bd7869911f3ba85e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.414538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ce363aa1-2120-413a-ae3d-1fbc55e5846c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23dea673a3104094bd7869911f3ba85e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:37.464034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 837/1646] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:37.511399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06002-badf-477b-ae81-843e7863b680 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:37.513040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-47a06002-badf-477b-ae81-843e7863b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:37.554277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 810/1647] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:36 2022] DELETE /identity/v3/users/23dea673a3104094bd7869911f3ba85e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:37.556042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:37.556332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:37.556657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:37.595716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:37.602863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:37.737996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:37.741469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06002-badf-477b-ae81-843e7863b680 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:37.858919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 811/1648] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:37.881537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:37.906047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:37.907312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:37.907850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:37.908246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:37.947693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:37.950174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:37.996802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 838/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:38.047142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fdc51-f622-46f6-bc5e-3cbac2a1c2da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:38.056831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:38.057504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:38.057782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:38.058055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:38.087526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:38.091336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:38.119244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 812/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:39.696469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:39.698586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:39.705230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:39.707718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:39.801489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5275b78-c342-434d-84f2-4100cf35ee28 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:39.803974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ea8-455b-45da-8357-3abdadb83306 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:39.814224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:39.816112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:39.816398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:39.816732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] PATH_INFO: `/v3/projects/ac1fd5eb212b42ca9e20832c18e437dc` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:39.818072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:39.818963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:39.819238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:39.819504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] PATH_INFO: `/v3/projects/493f7f45114e4c95bfebaaf7295ba472` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:39.820949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1fd5eb212b42ca9e20832c18e437dc)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:39.824906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=493f7f45114e4c95bfebaaf7295ba472)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:39.826653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:39.828684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:35:39.828684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 17 08:35:39.828684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: Jun 17 08:35:39.832652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:40.050600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:40.057151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1fd5eb212b42ca9e20832c18e437dc', 'request_id': 'req-fa8396b9-945b-4f8e-8f12-97623d148458'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.097539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1fd5eb212b42ca9e20832c18e437dc', 'request_id': 'req-fa8396b9-945b-4f8e-8f12-97623d148458'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.172746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493f7f45114e4c95bfebaaf7295ba472', 'request_id': 'req-600b2b62-aa50-4ccd-9060-b2bba25340ea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.225869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493f7f45114e4c95bfebaaf7295ba472', 'request_id': 'req-600b2b62-aa50-4ccd-9060-b2bba25340ea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.237073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493f7f45114e4c95bfebaaf7295ba472', 'request_id': 'req-600b2b62-aa50-4ccd-9060-b2bba25340ea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.245243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1fd5eb212b42ca9e20832c18e437dc', 'request_id': 'req-fa8396b9-945b-4f8e-8f12-97623d148458'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.272165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] The token cache is being invalidate because project ac1fd5eb212b42ca9e20832c18e437dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:40.273403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.276057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.281236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 839/1651] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:39 2022] DELETE /identity/v3/projects/ac1fd5eb212b42ca9e20832c18e437dc => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:40.293495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:40.297794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:40.365061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] The token cache is being invalidate because project 493f7f45114e4c95bfebaaf7295ba472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:40.365488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.366670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-600b2b62-aa50-4ccd-9060-b2bba25340ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:40.369551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 813/1652] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:39 2022] DELETE /identity/v3/projects/493f7f45114e4c95bfebaaf7295ba472 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:40.374626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842202b3-608a-4e14-a685-1fa4256c218a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:40.374992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842202b3-608a-4e14-a685-1fa4256c218a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:40.379380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842202b3-608a-4e14-a685-1fa4256c218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:40.466759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-842202b3-608a-4e14-a685-1fa4256c218a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:40.472693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-842202b3-608a-4e14-a685-1fa4256c218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:40.523752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8396b9-945b-4f8e-8f12-97623d148458 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:40.673354 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 814/1653] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:40.680201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:40.680521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:40.680803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:40.708119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:40.708119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:40.708119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:40.708119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] PATH_INFO: `/v3/users/1a90e42bbf654242b1c01535f6773e74` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:40.708743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a90e42bbf654242b1c01535f6773e74)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:40.710878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:40.726598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:40.744065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:40.746867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:40.768967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 815/1654] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:40.770230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:40.787462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a80b-e295-44f3-8d30-0f77b9f6296c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:40.797372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:40.798372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:40.799572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:40.800067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:40.801864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:40.802495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:40.804729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:40.824959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 816/1655] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:35:40.826186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:40.871788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f55f3e-3791-4c31-8407-305ae339364a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:40.880376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:40.882046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:40.882046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:40.882498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:40.883450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:40.886089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:41.001351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a90e42bbf654242b1c01535f6773e74'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:41.002892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a90e42bbf654242b1c01535f6773e74'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:41.003669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a90e42bbf654242b1c01535f6773e74'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:41.032994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a90e42bbf654242b1c01535f6773e74'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:41.042410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 817/1656] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:40 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:41.044079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:41.049701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a90e42bbf654242b1c01535f6773e74'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:41.052059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:41.145695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 840/1657] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:40 2022] DELETE /identity/v3/users/1a90e42bbf654242b1c01535f6773e74 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:41.168554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813582c-54ed-474c-baf8-d41f26afcfdb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:41.305842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:41.306554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:41.306840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:41.307268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:41.307987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:41.310083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:41.441381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 818/1658] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:41 2022] POST /identity/v3/users => generated 283 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:41.448514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:41.469306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761833b-4848-4ba2-ad96-39e12476a60c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:41.481493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:41.482459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:41.484148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:41.484614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:41.497079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:41.513672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:41.547331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:41.547985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 841/1659] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:41.575736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6bf7-fa84-440c-9151-923fafc56643 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:41.604293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:41.605083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:41.606195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:41.606768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:41.608293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:41.618473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded69b45-d2ac-40b1-930c-9cdc38829c43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:41.631712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 819/1660] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:35:41.640516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:41.660238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5cc4-9ecc-49cc-8dcb-5771de7c9ce2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:41.682501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:41.688087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:41.690443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:41.691088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] PATH_INFO: `/v3/projects/749a730949754017bd194d61d669a3b0/users/471ac92b5ad34db78dbd9f1b98775560/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:41.735882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749a730949754017bd194d61d669a3b0, user_id=471ac92b5ad34db78dbd9f1b98775560, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:41.743631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:41.879158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 842/1661] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:41 2022] PUT /identity/v3/projects/749a730949754017bd194d61d669a3b0/users/471ac92b5ad34db78dbd9f1b98775560/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:41.890838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:41.891850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:41.892331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:41.906081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:41.918827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:41.920853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:41.958402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] MFA Rules not processed for user `471ac92b5ad34db78dbd9f1b98775560`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:41.960387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:42.064330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 820/1662] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:42.068480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.074225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09e9b-672d-4fde-a0a1-935964a35038 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.089724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.090935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.091452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.091893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] PATH_INFO: `/v3/projects/887919e8f7884377840ebad895071429` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.097226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887919e8f7884377840ebad895071429)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.098965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0a23c-9a77-4c14-bf86-3c8443095505 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.101816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.115117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.117735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.118375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.118759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.120080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.125429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.263817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 821/1663] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:42 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:35:42.268570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.292832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887919e8f7884377840ebad895071429', 'request_id': 'req-90e217b6-ba83-4eeb-8569-228089a7d916'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:42.311023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887919e8f7884377840ebad895071429', 'request_id': 'req-90e217b6-ba83-4eeb-8569-228089a7d916'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:42.431225 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887919e8f7884377840ebad895071429', 'request_id': 'req-90e217b6-ba83-4eeb-8569-228089a7d916'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:42.438851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb34ea-1c61-486f-943a-8d2f188086f9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.460638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] The token cache is being invalidate because project 887919e8f7884377840ebad895071429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:42.461089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:42.463377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-90e217b6-ba83-4eeb-8569-228089a7d916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:42.475782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 843/1664] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:41 2022] DELETE /identity/v3/projects/887919e8f7884377840ebad895071429 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:42.478269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa142ce-ff7d-4808-9310-af05d4414d0e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.478916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa142ce-ff7d-4808-9310-af05d4414d0e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.480117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa142ce-ff7d-4808-9310-af05d4414d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.528197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4fa142ce-ff7d-4808-9310-af05d4414d0e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:42.550654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4fa142ce-ff7d-4808-9310-af05d4414d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:42.567053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.568071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.568545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.568898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.570134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.574743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.616275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 844/1665] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:42.623938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.624235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.624578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.645819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:42.653788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:42.664649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 845/1666] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:42.665985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.681150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c235-9aed-4581-90d6-60f14f9388a3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.711519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 822/1667] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:42 2022] POST /identity/v3/users => generated 289 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:42.711599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.711599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.711599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.711599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.712874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.728010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:42.732679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:42.733260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.739630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.763969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92eed6-1dac-4124-bd93-647086b6782e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.767513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 846/1668] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:35:42.772729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.780080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.781241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.781527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.782700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.798418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.802279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.803630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28650-5a5e-4e8e-8ff6-287d9b68279a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.819918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.824090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.824189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 823/1669] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:42.824262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.824262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.824262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.825574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.831652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:42.872838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01137-5a1c-4810-8f69-afc54dfe3c7f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:42.885072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:42.887501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:42.887501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:42.887501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] PATH_INFO: `/v3/projects/cdbde329cfda4652a02af559baf24c00/users/aa52ad4135a941b69a50565c04226f90/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:42.937639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbde329cfda4652a02af559baf24c00, user_id=aa52ad4135a941b69a50565c04226f90, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:42.943957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:42.977225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:43.022219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 847/1670] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:42 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:43.023366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.100783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 824/1671] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:42 2022] PUT /identity/v3/projects/cdbde329cfda4652a02af559baf24c00/users/aa52ad4135a941b69a50565c04226f90/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:43.106944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.167458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2ab2-2641-4480-8cf0-d0ef8ca2e70c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.247525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5cdd-d3bd-474e-b9bf-6eb94d202497 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.255590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.256290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.256985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.257284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.261362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.263143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.294469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 825/1672] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:43.295468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.307836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ef80-1145-4565-b7d4-c1959a9161f1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.314999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.315973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.316262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.316582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] PATH_INFO: `/v3/projects/cdbde329cfda4652a02af559baf24c00/users/aa52ad4135a941b69a50565c04226f90/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.319799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbde329cfda4652a02af559baf24c00, user_id=aa52ad4135a941b69a50565c04226f90, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.324768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06450c8-8695-419d-bea7-d430d7c471a5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.365695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 826/1673] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:43 2022] PUT /identity/v3/projects/cdbde329cfda4652a02af559baf24c00/users/aa52ad4135a941b69a50565c04226f90/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:43.376360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.376688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.377527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.387544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.388384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.388780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.389128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.391622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.395848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.443438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] MFA Rules not processed for user `aa52ad4135a941b69a50565c04226f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:43.444823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:43.509046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 848/1674] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:43 2022] POST /identity/v3/users => generated 285 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:43.518049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.536388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256b68-d086-4f8a-b05e-468d478ed316 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.598957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 827/1675] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:43.616735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.618229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:43.738054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.738763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.739046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.739320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.740069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.744989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.750169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34919adb-a9b8-4ce7-b799-3632405716da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.761258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.761939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.762218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.762493 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.769926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 849/1676] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:43.771359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.790576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.792065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.796538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243a67-061f-4cb6-bf0a-ce3940b0ed81 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.816986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 828/1677] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:35:43.835263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.838069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.838648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.839053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.839836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.846272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c1936-63ea-4474-bafc-49b185490658 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.879243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:43.881558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 850/1678] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:43.891917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d81ca-1cf5-4fe7-81b9-86470cb2ade6 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:43.906289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:43.910293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:43.914883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:43.915197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] PATH_INFO: `/v3/projects/3a7c2de8703041789a645f3e94a3cc34/users/ee5301e95a274b1e9585dc57b71d007f/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:43.941618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7c2de8703041789a645f3e94a3cc34, user_id=ee5301e95a274b1e9585dc57b71d007f, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:43.945535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:43.980517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:44.091262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 829/1679] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:43 2022] PUT /identity/v3/projects/3a7c2de8703041789a645f3e94a3cc34/users/ee5301e95a274b1e9585dc57b71d007f/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:35:44.108750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:44.109039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:44.109355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:44.175202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:44.191563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] MFA Rules not processed for user `ee5301e95a274b1e9585dc57b71d007f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:44.199390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:44.226290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:44.228206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:44.382416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d00896-2356-406e-b636-1d965ea7b52c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:44.390148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:44.391471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:44.391754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:44.392022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:44.398255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:44.427118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 851/1680] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:44.430361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:44.553446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:44.558148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:44.563863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6279a-fda1-4444-9aef-f83afbe644b2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:44.581585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:44.584301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:44.584907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:44.585374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:44.586291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:44.588643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:44.597918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 830/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:35:44.788668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 852/1682] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:44 2022] POST /identity/v3/projects => generated 369 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:44.794661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:44.808261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460be7a-9173-4f62-a69f-1dc530fd1f41 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:44.967485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:44.968435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:44.968934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:44.969621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:44.971672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:44.976640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6c740-d534-4a96-ad78-513bdcb3a147 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.122418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 831/1683] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:44 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:45.126571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:45.151582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f9f-1dcc-456c-99c7-2f6f8d0ca471 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:45.174102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:45.175206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.176072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.176505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.178023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:45.180776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.196312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6673-931f-4782-8e4d-e6ac5c2c6a30 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.196653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6673-931f-4782-8e4d-e6ac5c2c6a30 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.196932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6673-931f-4782-8e4d-e6ac5c2c6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.222445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 853/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:45.225441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:45.244794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487e071-8e70-4e70-9f7d-f3ca907e3483 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:45.248805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2a0a6673-931f-4782-8e4d-e6ac5c2c6a30 None None] MFA Rules not processed for user `a9cef287aa974448b3abef26a8018f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:45.251071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a0a6673-931f-4782-8e4d-e6ac5c2c6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:45.256174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:45.259771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:45.263258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.264314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.264314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] PATH_INFO: `/v3/projects/5c3c73c808c64abda823948ff512d65c/users/116bc71cbd9f4b6d80bc6d6c0f777914/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.301367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3c73c808c64abda823948ff512d65c, user_id=116bc71cbd9f4b6d80bc6d6c0f777914, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:45.307421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.371887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 832/1685] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:45.373993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.374410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.374909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.407757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] MFA Rules not processed for user `a9cef287aa974448b3abef26a8018f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:45.411110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:45.422396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 833/1686] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:45.435895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:45.438034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:45.458977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 854/1687] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:45 2022] PUT /identity/v3/projects/5c3c73c808c64abda823948ff512d65c/users/116bc71cbd9f4b6d80bc6d6c0f777914/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:45.462771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:45.547641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8963-65fc-45a7-ac6c-5e7891a1498e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:45.569588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2bf27-7189-4361-b67c-9d996a8b9344 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:45.575420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:45.576252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.576645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.576998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.577813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:45.580874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.593526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 855/1688] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:35:45.600917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:45.614067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51655-3d70-4900-b6dd-438f65ee40a4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:45.623480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:45.624187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.624585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.625176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] PATH_INFO: `/v3/projects/5c3c73c808c64abda823948ff512d65c/users/116bc71cbd9f4b6d80bc6d6c0f777914/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.629026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3c73c808c64abda823948ff512d65c, user_id=116bc71cbd9f4b6d80bc6d6c0f777914, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:45.635193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:45.636541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.637047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.637651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.646249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425eab-948a-4725-9074-3207e1f2d54a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.675492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 856/1689] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:45 2022] PUT /identity/v3/projects/5c3c73c808c64abda823948ff512d65c/users/116bc71cbd9f4b6d80bc6d6c0f777914/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:45.687004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763ea9-e642-4c17-b96c-70002ed44927 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:45.687400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763ea9-e642-4c17-b96c-70002ed44927 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:45.687688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763ea9-e642-4c17-b96c-70002ed44927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:45.742056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-f7763ea9-e642-4c17-b96c-70002ed44927 None None] MFA Rules not processed for user `116bc71cbd9f4b6d80bc6d6c0f777914`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:45.743303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f7763ea9-e642-4c17-b96c-70002ed44927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:45.788126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:45.790520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:45.827400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 834/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:35:45.861371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 857/1691] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:45.911058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:46.026027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:46.080368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4e7b3-c34d-42b9-9183-4fb925241b05 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:46.221736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:46.222407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:46.222692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:46.222969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:46.244035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:46.245595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc3fa6-bb54-46a5-ab34-0a6afa175804 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:46.272781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 835/1692] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:46.971336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f5ce-28c6-4221-b0e3-efceea957b36 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:46.972808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f5ce-28c6-4221-b0e3-efceea957b36 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:46.973315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f5ce-28c6-4221-b0e3-efceea957b36 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:46.983366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 858/1693] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 08:35:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:47.000602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:47.000888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:47.001165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:47.007734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:47.008022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:47.008298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:47.054039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:47.112709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] MFA Rules not processed for user `af32d2a5a83546699f5e2caa3def410d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:47.116801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:47.170004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:47.171313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:47.326538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 836/1694] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:47.335856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 859/1695] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:35:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:47.345903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:47.347729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:47.362152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb762b5-17fd-439d-a01b-74b4cc363433 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:47.367013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:47.368249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:47.369659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:47.370174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:47.381774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:47.383844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761ea2b-f49e-4f71-8126-b2cba8ba17a4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:47.399153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 837/1696] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:47.621668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:47.623121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:47.835293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d220ef-4a38-4133-b0d6-a939c2c282b2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:47.841539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:47.842350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:47.842737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:47.843394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:47.853742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:47.855699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948932fe-fc27-41bc-93c3-f2f7dae329a3 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:47.868921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:47.877601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 860/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:48.386076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8b93-3364-425e-8d6c-144cf18c0837 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.386596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8b93-3364-425e-8d6c-144cf18c0837 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.386696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8b93-3364-425e-8d6c-144cf18c0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.465260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-83ca8b93-3364-425e-8d6c-144cf18c0837 None None] MFA Rules not processed for user `fb1df28c175c40b7a06d1f94ba780d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:48.467083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-83ca8b93-3364-425e-8d6c-144cf18c0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:48.476220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7747-969e-48a9-ada7-6afd2e5e97cf None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.476748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7747-969e-48a9-ada7-6afd2e5e97cf None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.476861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7747-969e-48a9-ada7-6afd2e5e97cf None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.478739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 861/1698] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 17 08:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:48.484284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.484731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.485117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.565779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:48.570433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:48.581343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:48.671108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 838/1699] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:48.684007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.684804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.685616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.713539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] MFA Rules not processed for user `fb1df28c175c40b7a06d1f94ba780d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:48.715121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:48.723915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 862/1700] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 17 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:48.726570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:48.729626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 839/1701] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:35:48.738407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:48.756768 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f43c8-7195-42bd-9930-1ea6f950706a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:48.759785 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfa0c2-f6b1-4c01-b266-f16a573015ad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:48.762939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:48.763771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.764057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.764333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.766159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:48.766340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:48.767357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:48.767511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:48.767933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:48.778422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:48.780295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:48.782203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:48.794692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 863/1702] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:48.797504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063f84-d2c5-4c88-89d8-ae92f790a90b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:48.808976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 840/1703] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:49.472265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:49.563513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:49.570546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:49.685234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a8f2-7a05-46ba-9130-7699ff8023f2 service placement] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:49.699635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:49.700857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:49.701309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:49.701779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] PATH_INFO: `/v3/users/ee5301e95a274b1e9585dc57b71d007f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:49.704972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5301e95a274b1e9585dc57b71d007f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:49.707416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:50.013983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5301e95a274b1e9585dc57b71d007f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:50.015159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5301e95a274b1e9585dc57b71d007f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:50.016332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5301e95a274b1e9585dc57b71d007f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:50.051739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5301e95a274b1e9585dc57b71d007f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:50.072843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da01f999-33d4-4265-a848-5fec1d2a4d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5301e95a274b1e9585dc57b71d007f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:50.158044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:50.161632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:50.162012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:50.173047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 864/1704] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:49 2022] DELETE /identity/v3/users/ee5301e95a274b1e9585dc57b71d007f => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:50.181252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e2b1-507f-4c80-bc53-4619d53b5da4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:50.182922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e2b1-507f-4c80-bc53-4619d53b5da4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:50.183506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e2b1-507f-4c80-bc53-4619d53b5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:50.210861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] MFA Rules not processed for user `fb1df28c175c40b7a06d1f94ba780d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:50.213625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:50.230581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a395e2b1-507f-4c80-bc53-4619d53b5da4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:50.233131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a395e2b1-507f-4c80-bc53-4619d53b5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:50.360738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 841/1705] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:50.379154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:50.379301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 865/1706] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:50.383386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:50.541525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e0ce0-5bdc-4d86-8cda-f00859a8ddbe None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:50.548543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:50.549203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:50.549647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:50.549955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:50.575333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:50.576919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369353b3-64b9-42df-a861-72bebc0331b4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:50.598348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 842/1707] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:51.178083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:51.178978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:51.179460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:51.182353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 866/1708] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 08:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:51.189415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:51.190029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:51.190462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:51.216739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:51.218281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:51.227458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 843/1709] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:51.420357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:51.502882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:51.506173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:51.523531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b599-dac7-471b-a2eb-d51c36913d7f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:51.539898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:51.542301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:51.584809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:51.587480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:51.589156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:51.598933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:51.613248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ec3a-c7ad-470b-927c-3e323cacc8e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:51.643444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:51.645866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:51.648697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:51.651846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:51.659056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:51.659739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] PATH_INFO: `/v3/projects/3a7c2de8703041789a645f3e94a3cc34` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:51.664117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7c2de8703041789a645f3e94a3cc34)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:51.671868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:51.695332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 867/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:51.891072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7c2de8703041789a645f3e94a3cc34', 'request_id': 'req-7964e4fa-8802-4d72-8e52-242af7150e66'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:51.892820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:51.919003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7c2de8703041789a645f3e94a3cc34', 'request_id': 'req-7964e4fa-8802-4d72-8e52-242af7150e66'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:51.936327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7c2de8703041789a645f3e94a3cc34', 'request_id': 'req-7964e4fa-8802-4d72-8e52-242af7150e66'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.098501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] The token cache is being invalidate because project 3a7c2de8703041789a645f3e94a3cc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:52.098993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.102969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7964e4fa-8802-4d72-8e52-242af7150e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.114519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:52.119254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 844/1711] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:51 2022] DELETE /identity/v3/projects/3a7c2de8703041789a645f3e94a3cc34 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:35:52.137012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe1c0-c817-4230-ae1d-ebb81e943303 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:52.246211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:52.247113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:52.247396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:52.247675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] PATH_INFO: `/v3/users/116bc71cbd9f4b6d80bc6d6c0f777914` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:52.253525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116bc71cbd9f4b6d80bc6d6c0f777914)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:52.256695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:52.568881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116bc71cbd9f4b6d80bc6d6c0f777914'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.569472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116bc71cbd9f4b6d80bc6d6c0f777914'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.570165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116bc71cbd9f4b6d80bc6d6c0f777914'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.639850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116bc71cbd9f4b6d80bc6d6c0f777914'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.650454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116bc71cbd9f4b6d80bc6d6c0f777914'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:52.819319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 868/1712] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:52 2022] DELETE /identity/v3/users/116bc71cbd9f4b6d80bc6d6c0f777914 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:52.968654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:52.969406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:52.969718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:53.031799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] MFA Rules not processed for user `af32d2a5a83546699f5e2caa3def410d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:53.034942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:53.241134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 845/1713] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:53.717672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:53.729366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:53.819677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:53.824777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:53.856864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:53.979496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dccf8-bbad-4dd8-8ea3-4878d918dc57 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:53.984795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148680-19f7-40dc-8b12-786cdb35af9d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:53.988417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:53.989648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:53.989648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:53.992992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] PATH_INFO: `/v3/users/471ac92b5ad34db78dbd9f1b98775560` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:53.994916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=471ac92b5ad34db78dbd9f1b98775560)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:54.001963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:54.002959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:54.003138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:54.003516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:54.003890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] PATH_INFO: `/v3/users/fe87a25072b04f9890e1aab97d6a40ef` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:54.007701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe87a25072b04f9890e1aab97d6a40ef)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:54.012583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:54.340851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471ac92b5ad34db78dbd9f1b98775560'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.341666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471ac92b5ad34db78dbd9f1b98775560'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.342653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471ac92b5ad34db78dbd9f1b98775560'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.369230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471ac92b5ad34db78dbd9f1b98775560'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.406126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471ac92b5ad34db78dbd9f1b98775560'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.447362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe87a25072b04f9890e1aab97d6a40ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.449393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe87a25072b04f9890e1aab97d6a40ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.455139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe87a25072b04f9890e1aab97d6a40ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.484974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe87a25072b04f9890e1aab97d6a40ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.505509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 869/1714] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:53 2022] DELETE /identity/v3/users/471ac92b5ad34db78dbd9f1b98775560 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:54.527550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:54.535478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:54.536318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-084d7251-25cc-4caf-b874-addfef4a8418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe87a25072b04f9890e1aab97d6a40ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:54.684242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 846/1715] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:53 2022] DELETE /identity/v3/users/fe87a25072b04f9890e1aab97d6a40ef => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:35:54.685963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8daff4-57de-469a-be00-0be035d171d4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:54.689134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8daff4-57de-469a-be00-0be035d171d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:54.691945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8daff4-57de-469a-be00-0be035d171d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:54.707616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda404a-7712-4bbe-95fc-638f55fd65ec admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:54.724155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:54.748034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7f8daff4-57de-469a-be00-0be035d171d4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:54.753461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f8daff4-57de-469a-be00-0be035d171d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:54.924738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:54.926250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:54.929356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:54.929832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] PATH_INFO: `/v3/projects/5c3c73c808c64abda823948ff512d65c` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:54.931619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3c73c808c64abda823948ff512d65c)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:54.935951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:54.998602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 847/1716] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:55.000433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66f09-26a3-4d94-b1e5-45d68ce3fa78 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.000884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66f09-26a3-4d94-b1e5-45d68ce3fa78 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.001900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66f09-26a3-4d94-b1e5-45d68ce3fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:55.061493 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-08b66f09-26a3-4d94-b1e5-45d68ce3fa78 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:55.062770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-08b66f09-26a3-4d94-b1e5-45d68ce3fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.095963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 848/1717] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:55.097375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.097663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.103059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:55.136834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:55.138053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.178290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3c73c808c64abda823948ff512d65c', 'request_id': 'req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:55.207346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3c73c808c64abda823948ff512d65c', 'request_id': 'req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:55.297476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 849/1718] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:55.298595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:55.301287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.345422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3c73c808c64abda823948ff512d65c', 'request_id': 'req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:55.365531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] The token cache is being invalidate because project 5c3c73c808c64abda823948ff512d65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:55.366044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:55.366871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:55.374518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 870/1719] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:54 2022] DELETE /identity/v3/projects/5c3c73c808c64abda823948ff512d65c => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:55.375740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:55.379673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.478849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d8d6-b582-4d86-85d8-a23ac0b46d80 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:55.484896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:55.487315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.487781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.488406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:55.494175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.535642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f51d9-dd3f-4ace-bed2-5362c6c2b4bc admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:55.540722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:55.541562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.541981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.542376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:55.545428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.738401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:55.749092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dffaf9-c93c-49a0-be3f-1714748a600b service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:55.810193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:55.810193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200983-cff6-48dc-8b7b-8c4805cccdd2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:55.823729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 871/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:55.825207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.825500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.825784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:55.834064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 850/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:35:55.905906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:55.909850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:55.955216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 872/1722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:55.961486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:55.962664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:55.964351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.006549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:56.009167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:56.021672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 851/1723] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:56.025967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.114314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.140872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:56.150640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee741a42-4041-4d03-acb4-e666ed7379d4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.209446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.209446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.209446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.209446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.210151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:56.210151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.213569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:56.241241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 873/1724] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:56.244784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.265145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8291d-4247-40d6-86eb-d6ceac2f1467 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.275325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.279787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.280083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.280363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.281112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.284733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:56.372906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f34d8-8a5d-4047-99c0-87389cacd118 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.383967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.384912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.385334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.388261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.395687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:56.415225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.432567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 874/1725] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:56 2022] POST /identity/v3/projects => generated 355 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:35:56.432997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:56.435105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.479585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 852/1726] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:56.524722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dab8-dd48-4a6f-afa8-8ec662b833c0 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.568766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.570626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.570886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.577963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.582099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.589653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:56.765087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.767964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 875/1727] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:56 2022] POST /identity/v3/users => generated 278 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:56.787737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdef7e-fe71-458a-a788-2b0a807f0be6 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.800202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.801272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.801747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.802183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.803087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.807823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:56.828194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:56.864920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 853/1728] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:35:56.867096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:56.889933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9831-836a-4c40-ac4c-8da839069a57 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:56.937947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:56.943173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:56.949729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:56.950333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:56.956365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:56.960307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef0f7-2168-43c0-a7db-da47f2d71968 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:57.013461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 876/1729] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:57.014830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:57.028273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989847-fcd6-4b1b-aef9-1cb84447cc57 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:57.038959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:57.040732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:57.041160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:57.041577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] PATH_INFO: `/v3/projects/14e30f8d3f9042b8a7347c381a737f4e/users/ff90011cb5e843438ec0019fd7587bd5/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:57.094208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e30f8d3f9042b8a7347c381a737f4e, user_id=ff90011cb5e843438ec0019fd7587bd5, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:57.097554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:57.206083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 854/1730] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:57 2022] PUT /identity/v3/projects/14e30f8d3f9042b8a7347c381a737f4e/users/ff90011cb5e843438ec0019fd7587bd5/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:57.217655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:57.220901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:57.221338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:57.354999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] MFA Rules not processed for user `ff90011cb5e843438ec0019fd7587bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:57.356262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:57.511350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:57.524079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 877/1731] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:57.528354 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:57.699958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14750791-8f80-4869-9f89-121c16d1b136 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:57.720830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:57.721830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:57.722124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:57.723996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:57.727300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:57.729316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:57.880044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:57.888969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 855/1732] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:57 2022] POST /identity/v3/projects => generated 355 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:57.893545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7f16-0758-4c4d-88d1-6d51b317382d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:57.930275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:57.933421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:58.241722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:58.241722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:58.241722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:58.241722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:58.244034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:58.244034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:58.245700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c1ec-befe-424a-b395-daf9af6f85e8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:58.245700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:58.245700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:58.245700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:58.246830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] PATH_INFO: `/v3/projects/9398f73795f54f46b21bfcecbfd9c980` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:58.246830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9398f73795f54f46b21bfcecbfd9c980)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:58.246830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:58.574734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 878/1733] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:57 2022] POST /identity/v3/users => generated 284 bytes in 695 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:58.576570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:58.581787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:58.608582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9398f73795f54f46b21bfcecbfd9c980', 'request_id': 'req-4def8fa3-3eaf-4848-8a49-d75ff9034801'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:58.628216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9398f73795f54f46b21bfcecbfd9c980', 'request_id': 'req-4def8fa3-3eaf-4848-8a49-d75ff9034801'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:58.648795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9398f73795f54f46b21bfcecbfd9c980', 'request_id': 'req-4def8fa3-3eaf-4848-8a49-d75ff9034801'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:58.659269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2255-b3a8-4ea7-8d6e-e5310de77c28 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:58.737500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] The token cache is being invalidate because project 9398f73795f54f46b21bfcecbfd9c980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:58.738047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:58.740971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:58.750291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 856/1734] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:57 2022] DELETE /identity/v3/projects/9398f73795f54f46b21bfcecbfd9c980 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:58.782900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:58.798736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:58.813115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:58.946626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:58.950567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:58.951075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:58.952744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] PATH_INFO: `/v3/projects/749a730949754017bd194d61d669a3b0` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:58.956853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749a730949754017bd194d61d669a3b0)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:58.959527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:58.998107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8fa3-3eaf-4848-8a49-d75ff9034801 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.007126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.008915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.009527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.010001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.011004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.015952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3d3e-af9d-49f8-b5fe-05d9246052eb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.057238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 857/1735] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:59.059766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e595c5-2eaa-4acb-97c8-30ac693a2509 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.060197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e595c5-2eaa-4acb-97c8-30ac693a2509 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.060874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e595c5-2eaa-4acb-97c8-30ac693a2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.085576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a1e595c5-2eaa-4acb-97c8-30ac693a2509 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:59.087158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1e595c5-2eaa-4acb-97c8-30ac693a2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.100699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 858/1736] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:59.103078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.109044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.109044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.133670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:59.137798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.167058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749a730949754017bd194d61d669a3b0', 'request_id': 'req-eeb03519-7dac-472e-8733-71448422f8a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.176655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749a730949754017bd194d61d669a3b0', 'request_id': 'req-eeb03519-7dac-472e-8733-71448422f8a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.241937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749a730949754017bd194d61d669a3b0', 'request_id': 'req-eeb03519-7dac-472e-8733-71448422f8a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.273652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 859/1737] 10.222.0.75 () {58 vars in 1015 bytes} [Fri Jun 17 08:35:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:59.275909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.289747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] The token cache is being invalidate because project 749a730949754017bd194d61d669a3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:35:59.292851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.293925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-eeb03519-7dac-472e-8733-71448422f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.296008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 879/1738] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:35:58 2022] DELETE /identity/v3/projects/749a730949754017bd194d61d669a3b0 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:59.301346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.301887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.310751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.338058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:59.341505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.369725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e98c5-04fc-4708-8505-f56673fb0a26 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.376366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.376366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.376366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.376750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] PATH_INFO: `/v3/projects/3ebeecf729d140d2b1b49a457459612b/users/7c357a73ab3b42e48be3012528a3a9ef/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.401242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebeecf729d140d2b1b49a457459612b, user_id=7c357a73ab3b42e48be3012528a3a9ef, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.404367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.430532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 880/1739] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:35:59.431398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.432880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.445882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84d0f-bf4a-401b-8748-c68edaa747ea None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.450786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.451667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.451948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.452217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] PATH_INFO: `/v3/users/aa52ad4135a941b69a50565c04226f90` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.453761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa52ad4135a941b69a50565c04226f90)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.455894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.504576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 860/1740] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:59 2022] PUT /identity/v3/projects/3ebeecf729d140d2b1b49a457459612b/users/7c357a73ab3b42e48be3012528a3a9ef/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:59.504576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.596260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b66b1-3d2a-4dd3-a22f-3d65406a1b8f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.602625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.603304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.603583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.603871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.604696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:59.610772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.610772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.628114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 861/1741] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:59.628114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.633253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.656384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bdf5c-8f78-4d38-b7a2-69adef648f53 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.668521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.682951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.682951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.682951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.682951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.682951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.687482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 862/1742] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:35:59.689137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.700722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680aa-088d-4e31-b6fb-fe688295854f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:59.706464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:59.707436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:59.707761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:59.708208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:59.709009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:59.711436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:59.772432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa52ad4135a941b69a50565c04226f90'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.773445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa52ad4135a941b69a50565c04226f90'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.774088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa52ad4135a941b69a50565c04226f90'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.800318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa52ad4135a941b69a50565c04226f90'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.809028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa52ad4135a941b69a50565c04226f90'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:35:59.835266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:59.846433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 863/1743] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:35:59 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:59.847774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.850162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:59.922292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 881/1744] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:35:59 2022] DELETE /identity/v3/users/aa52ad4135a941b69a50565c04226f90 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:59.924163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:59.929562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.002191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5182-3ef5-46f0-aedf-d1f98a2746f3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.154236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab309-469c-4ef8-8277-73c5e51949a4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.162816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.164200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.164961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.165710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.167451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.177806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.216402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.217875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.218167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.218448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] PATH_INFO: `/v3/projects/3ebeecf729d140d2b1b49a457459612b/users/7c357a73ab3b42e48be3012528a3a9ef/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.221064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebeecf729d140d2b1b49a457459612b, user_id=7c357a73ab3b42e48be3012528a3a9ef, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.223843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.276137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 864/1745] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:35:59 2022] PUT /identity/v3/projects/3ebeecf729d140d2b1b49a457459612b/users/7c357a73ab3b42e48be3012528a3a9ef/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:00.277934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.290981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.309510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 882/1746] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:35:59 2022] POST /identity/v3/users => generated 286 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:00.311448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.319437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.440707 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329851d-3ad8-4a6f-b1f0-a586fff5defe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.455439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5469c-dbd6-4f14-bb10-7fa72217d2f1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.465680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.465680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.465680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.465680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.466252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.466359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.466495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.467353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.468813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.476237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.494046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.497847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.499026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.503769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee5298-41a0-4015-88d3-0af9b3524144 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.511298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:00.535081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 865/1747] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:00.536318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 883/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:00.539375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.542085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.542551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.543109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.571960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c24da-4fee-4d1c-9519-f171f731d3d4 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.577481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.578997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.579390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.579716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.591633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.593209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.605141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 866/1749] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:00.606970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.612247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] MFA Rules not processed for user `7c357a73ab3b42e48be3012528a3a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:00.615466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.770627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 884/1750] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:00.788207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.791377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c3ab-d405-465e-aee3-b819b13cb4ca service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.792787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:00.809393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.810347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.810705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.811165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.811989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.815797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.836800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 867/1751] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:00.842180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.858538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af116f-ef27-4d0e-a19e-bd7e6b0eb21e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.867514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.868342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.868880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.869228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.870576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.872852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.921510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 868/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:00.924668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:00.932613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fe6d-d793-412f-a8f5-01e94b87b16c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.939822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.940724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.941015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.941294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.947295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97677a-8b23-4bb8-a2fb-ed738d320136 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:00.956688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:00.957912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:00.958179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856b41f-6eb1-4afd-b7e3-c38507b84892 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:00.959081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:00.959495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:00.960014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] PATH_INFO: `/v3/projects/f0216b5fbc2a4456bd139fc18724f073/users/908d2ee68b1a4da1b958e00db174db07/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:00.980135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 885/1753] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:01.011216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0216b5fbc2a4456bd139fc18724f073, user_id=908d2ee68b1a4da1b958e00db174db07, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:01.014682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:01.127074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 869/1754] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:00 2022] PUT /identity/v3/projects/f0216b5fbc2a4456bd139fc18724f073/users/908d2ee68b1a4da1b958e00db174db07/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:01.136526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:01.137382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:01.137731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:01.186301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] MFA Rules not processed for user `908d2ee68b1a4da1b958e00db174db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:01.190152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:01.257172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:01.389103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 886/1755] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:01.397436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:01.398385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff62df-1221-418a-a40e-7f3b55d59a54 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:01.399891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:01.408020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:01.408722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:01.409005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:01.409282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:01.416652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:01.566881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:01.568945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:01.600398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51210-d51b-42a6-9e96-adbcc88e5af6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:01.607304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:01.608030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:01.608869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:01.608869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:01.616827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 870/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:01.619993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:01.621676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:01.626749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:01.634726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:01.637094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 887/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:01.638991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:01.642884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:01.832817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c27e45-cce9-4bc8-aa60-f2cf19dfb462 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:01.842518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09baf44-2018-41cb-9df6-cdf5aa314644 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:01.844573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:01.847915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:01.848398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:01.848937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] PATH_INFO: `/v3/users/4317a4081cef445189ed4907789fae26` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:01.849899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:01.851236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:01.851956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:01.853690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4317a4081cef445189ed4907789fae26)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:01.854610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] PATH_INFO: `/v3/projects/cdbde329cfda4652a02af559baf24c00` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:01.856937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:01.867194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbde329cfda4652a02af559baf24c00)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:01.870374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:01.886734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:02.042140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbde329cfda4652a02af559baf24c00', 'request_id': 'req-b3045cba-cc48-45d6-b946-02d56c6af0d5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.056268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbde329cfda4652a02af559baf24c00', 'request_id': 'req-b3045cba-cc48-45d6-b946-02d56c6af0d5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.064879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbde329cfda4652a02af559baf24c00', 'request_id': 'req-b3045cba-cc48-45d6-b946-02d56c6af0d5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.156010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] The token cache is being invalidate because project cdbde329cfda4652a02af559baf24c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:02.156308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.157088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b3045cba-cc48-45d6-b946-02d56c6af0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.160160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 871/1758] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:01 2022] DELETE /identity/v3/projects/cdbde329cfda4652a02af559baf24c00 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:02.160970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4317a4081cef445189ed4907789fae26'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.165179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132dbd-d6cc-4ef3-b0e7-5826740fec57 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:02.165683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4317a4081cef445189ed4907789fae26'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.166427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132dbd-d6cc-4ef3-b0e7-5826740fec57 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:02.166952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4317a4081cef445189ed4907789fae26'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.167516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132dbd-d6cc-4ef3-b0e7-5826740fec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:02.208246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4317a4081cef445189ed4907789fae26'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.218532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-04132dbd-d6cc-4ef3-b0e7-5826740fec57 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:02.223621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04132dbd-d6cc-4ef3-b0e7-5826740fec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:02.226952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-71e735ee-a172-4c6f-b3eb-ee11d1d880dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4317a4081cef445189ed4907789fae26'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:02.316190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:02.409117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 888/1759] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:01 2022] DELETE /identity/v3/users/4317a4081cef445189ed4907789fae26 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:02.415381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:02.421458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:02.421458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:02.471450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 872/1760] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:02.476829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:02.477409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:02.477842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:02.515495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:02.519714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:02.542152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:02.546435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:02.668656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 873/1761] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:02.673902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:02.709867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635689c-8f9e-496d-a688-a5cdcb289891 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:02.732195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:02.737923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:02.737923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:02.737923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:02.744554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:02.744554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:02.751802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 889/1762] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:02.759997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:02.794865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 874/1763] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:02.796176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:02.808061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9ddf-26bf-4c91-a126-eb3ab02d36c3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:02.816317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:02.817958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:02.819199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:02.835600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:02.843423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:02.843710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:02.843992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:02.848946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:02.851008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.006990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecb4e-ea41-4a5a-8209-417fa555b0e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:03.017687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:03.018371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.018806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.019135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.059981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:03.061200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:03.062763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.072221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 890/1764] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:02 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:03.073354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:03.100005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 875/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:03.274234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96437-de90-46de-bcc9-063ae422f72d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:03.287287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:03.288082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.288368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.290818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.291669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:03.295359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.492620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 891/1766] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:03 2022] POST /identity/v3/users => generated 294 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:03.496454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:03.512433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1bd5-1675-417b-afd5-492e888517d3 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:03.530233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:03.534484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.535348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.535645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.539461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:03.544914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492186-5679-446d-bc54-132ce4665397 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.593615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 876/1767] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:03.595805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:03.636924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be919ea-c6e5-43fc-bc2b-6693f256cf40 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:03.656187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:03.659967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.660262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.660584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.661365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:03.669328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17f63-b815-426d-9eb0-464dd7a1fafc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.669746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17f63-b815-426d-9eb0-464dd7a1fafc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.671948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17f63-b815-426d-9eb0-464dd7a1fafc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.672180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 877/1768] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:03.679091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e1a1-ab40-4802-9910-5f929105b4f7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.713118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f17f63-b815-426d-9eb0-464dd7a1fafc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:03.716963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 892/1769] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:03.733262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f17f63-b815-426d-9eb0-464dd7a1fafc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:03.740410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:03.741483 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.741590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.741942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] PATH_INFO: `/v3/projects/e7587dd7ee1a4b1ab739db6096f21d7c/users/fc63613dcd3e4ff88f3c00c011b9a4a3/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.764005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7587dd7ee1a4b1ab739db6096f21d7c, user_id=fc63613dcd3e4ff88f3c00c011b9a4a3, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:03.769883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad7251-d558-4ea9-8d97-1e115d84007a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:03.871898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0f2e-df8b-4142-97fe-5d033047c751 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.872192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0f2e-df8b-4142-97fe-5d033047c751 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.872471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0f2e-df8b-4142-97fe-5d033047c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.931909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 878/1770] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:03 2022] PUT /identity/v3/projects/e7587dd7ee1a4b1ab739db6096f21d7c/users/fc63613dcd3e4ff88f3c00c011b9a4a3/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:03.935369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7eda0f2e-df8b-4142-97fe-5d033047c751 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:03.935369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7eda0f2e-df8b-4142-97fe-5d033047c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:03.935723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384737-5ca1-44f6-8047-8145a2fb4fbb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.935723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384737-5ca1-44f6-8047-8145a2fb4fbb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.935723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98384737-5ca1-44f6-8047-8145a2fb4fbb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:03.936325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 879/1771] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:03.943080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:03.947713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:03.948069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.070635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] MFA Rules not processed for user `fc63613dcd3e4ff88f3c00c011b9a4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:04.071366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:04.175448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 893/1772] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:04.181160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:04.181438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:04.183319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.269566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:04.277440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:04.315384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 894/1773] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:04.342332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 880/1774] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:04.349198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:04.349901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:04.413462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:04.416605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:04.455249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71925-ccab-412f-bfb3-e58e32f23df3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:04.474275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:04.475804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:04.477772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:04.481015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.509940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:04.519347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:04.527115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c14c-0128-4884-8348-2badbebdc324 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:04.534803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 881/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:04.540668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:04.544207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:04.544207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:04.544207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:04.544837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.545683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:04.552304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:04.690593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 895/1776] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:04 2022] POST /identity/v3/projects => generated 387 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:04.694971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:04.731500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b46e6-aa21-4a87-95e0-7f63790fcc84 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:04.769048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:04.770961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:04.855919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:04.856648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:04.857095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:04.857512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.875036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:04.877627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:04.966371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061ddc-9e48-4266-ba3b-45313f9b9ef8 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:04.980134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:04.980943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:04.981251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:04.981533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:04.995100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:05.001088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:05.013026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 896/1777] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:05.028803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 882/1778] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:04 2022] POST /identity/v3/users => generated 300 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:05.035022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:05.066919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129dba2-a2ac-4523-a615-1cc38a5ccbba service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:05.075233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:05.075922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:05.080895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:05.080895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:05.080895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:05.080895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:05.118926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 897/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:05.123737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:05.141024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471e0fe-0df0-4779-830f-5d1f7c45662b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:05.147140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:05.148166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:05.148452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:05.148811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] PATH_INFO: `/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21/users/8e111aa6140b4a7e80c56aedbd02dd71/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:05.167663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a0df95bc24f51a8c8bd66fbde5a21, user_id=8e111aa6140b4a7e80c56aedbd02dd71, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:05.170697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:05.322406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:05.324182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 883/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:05 2022] PUT /identity/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21/users/8e111aa6140b4a7e80c56aedbd02dd71/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:05.355398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c918-05d6-4624-9c0a-523a9d31d64e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:05.621013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:05.621878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:05.622167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:05.622448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:05.623207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:05.626358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f1f2d-9397-40af-bcf8-552e24ea6df6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:05.650589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 898/1781] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:05.655131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:05.677571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f52-c25b-4030-80f7-078f9295789a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:05.699582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:05.700699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:05.720005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:05.720005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] PATH_INFO: `/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21/users/8e111aa6140b4a7e80c56aedbd02dd71/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:05.725152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a0df95bc24f51a8c8bd66fbde5a21, user_id=8e111aa6140b4a7e80c56aedbd02dd71, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:05.733024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:05.765439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 884/1782] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:05 2022] PUT /identity/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21/users/8e111aa6140b4a7e80c56aedbd02dd71/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:05.776333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:05.776706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:05.776951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:05.960878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] MFA Rules not processed for user `8e111aa6140b4a7e80c56aedbd02dd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:05.966260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.162203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:06.166466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.291037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 899/1783] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:06.337845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758121-8f2c-4a92-8310-117e4522c3ba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:06.357443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:06.358982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:06.359259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:06.359537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] PATH_INFO: `/v3/projects/bf23aa46d9a34f5f99bcdebbe1d2662f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:06.362620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf23aa46d9a34f5f99bcdebbe1d2662f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:06.366446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:06.567500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:06.570168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.581196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf23aa46d9a34f5f99bcdebbe1d2662f', 'request_id': 'req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:06.600347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf23aa46d9a34f5f99bcdebbe1d2662f', 'request_id': 'req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:06.615330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf23aa46d9a34f5f99bcdebbe1d2662f', 'request_id': 'req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:06.693367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] The token cache is being invalidate because project bf23aa46d9a34f5f99bcdebbe1d2662f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:06.694045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:06.694452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0162d0fc-1bcd-4f0e-970f-ed53d6b46624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:06.696453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 885/1784] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:06 2022] DELETE /identity/v3/projects/bf23aa46d9a34f5f99bcdebbe1d2662f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:06.702609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ead1f-9144-4649-9f2f-580c5f3b7457 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:06.702897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ead1f-9144-4649-9f2f-580c5f3b7457 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:06.705025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ead1f-9144-4649-9f2f-580c5f3b7457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:06.738760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af88878-0e03-4413-9266-c92ce7e766c7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:06.755206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-188ead1f-9144-4649-9f2f-580c5f3b7457 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:06.759917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-188ead1f-9144-4649-9f2f-580c5f3b7457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.784507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:06.863765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:06.865172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:06.865873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:06.866459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:06.868419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.889469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 886/1785] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:06.899660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:06.899968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:06.900371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:06.938510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:06.939888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:06.952390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 887/1786] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:06.958773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:06.990359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a861251-b9be-443b-bcbb-0aedb335d332 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.004990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.005684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.009983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.009983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.009983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:07.009983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.009983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.024189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.026944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.036162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 888/1787] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:07.037130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.050303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02244a4-7b67-4785-8e3b-091b39da79e5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.057898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 900/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:07.060962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.061793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.062075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.062346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.064625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.065577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:07.067301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.107265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.111293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:07.140172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ced5-ec70-4907-bd30-dad9330e9a7e service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.151755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.154659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.155554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.155554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] PATH_INFO: `/v3/users/fc63613dcd3e4ff88f3c00c011b9a4a3` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.158922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc63613dcd3e4ff88f3c00c011b9a4a3)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.164914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.277786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 889/1789] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:07 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:07.288467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.479978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc63613dcd3e4ff88f3c00c011b9a4a3'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:07.481478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc63613dcd3e4ff88f3c00c011b9a4a3'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:07.487142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc63613dcd3e4ff88f3c00c011b9a4a3'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:07.505905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8b6e-4888-46f5-b82f-4bcc310cf3cb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.512828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc63613dcd3e4ff88f3c00c011b9a4a3'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:07.523741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a8746c42-851a-4e46-b718-4563db1d0aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc63613dcd3e4ff88f3c00c011b9a4a3'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:07.524957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.528441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.529085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.529441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.530591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.533898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.619704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 901/1790] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:07 2022] DELETE /identity/v3/users/fc63613dcd3e4ff88f3c00c011b9a4a3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:07.628540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.628540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.628540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.666440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:07.667822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:07.709906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 890/1791] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:07 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:07.711137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.716936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:07.755515 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe49c07-d830-4a91-b225-054e372eb69d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.882529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 902/1792] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:07.914293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.915811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.916358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.916909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.919653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.922112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:07.937472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 891/1793] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:07.942640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.953793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035589-d3ac-4915-b69f-bad4272d31f1 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:07.956080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:07.958527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:07.970075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:07.970416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:07.970686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:07.970963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:07.971741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:07.974757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:07.982876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.014933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 903/1794] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:08.019617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:08.044752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd4e12-d4be-4a11-8af4-a0c33c081d11 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:08.051646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:08.053743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.054384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.054384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] PATH_INFO: `/v3/projects/1caffb5cdf564fe69571b6b9c16d923a/users/4a5e5b3b83e349bc927fe9161b5a2e16/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.081197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caffb5cdf564fe69571b6b9c16d923a, user_id=4a5e5b3b83e349bc927fe9161b5a2e16, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:08.088138 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177505e-3719-4898-b852-7ff1b85ecf9d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.162933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65714-10bf-436b-8462-d6aa9934a25b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:08.177383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:08.181130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.181855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.182498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.189333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 904/1795] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:08 2022] PUT /identity/v3/projects/1caffb5cdf564fe69571b6b9c16d923a/users/4a5e5b3b83e349bc927fe9161b5a2e16/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:08.202359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.202937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.203675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.233668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:08.239949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.274858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] MFA Rules not processed for user `4a5e5b3b83e349bc927fe9161b5a2e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:08.276119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:08.290032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 892/1796] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:08.290934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:08.296693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:08.324851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881137c2-f35e-4e47-b153-3e9d23eb7ee4 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:08.521385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:08.523195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.523510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.525243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] PATH_INFO: `/v3/users/908d2ee68b1a4da1b958e00db174db07` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.528238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=908d2ee68b1a4da1b958e00db174db07)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:08.535266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.554597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 905/1797] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:08.560694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:08.579321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00fd1b-389a-4889-9b78-6c77f45f50fc None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:08.586754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:08.587654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.588044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.588428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.590336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:08.594864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.738050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 906/1798] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:08 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:08.753608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:08.861960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908d2ee68b1a4da1b958e00db174db07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:08.864768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908d2ee68b1a4da1b958e00db174db07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:08.866149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908d2ee68b1a4da1b958e00db174db07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:08.894988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d478a7-d9ce-4513-8354-795e7c6ec595 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:08.899395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908d2ee68b1a4da1b958e00db174db07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:08.900081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:08.903174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.903542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:08.903899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:08.904709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:08.907710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:08.911018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-593c2e9b-c478-408f-a1f7-7b5e981516bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908d2ee68b1a4da1b958e00db174db07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:08.989660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 907/1799] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:08 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:08.993638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:08.993880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 893/1800] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:08 2022] DELETE /identity/v3/users/908d2ee68b1a4da1b958e00db174db07 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:08.996830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:08.998976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:08.999541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.001186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.023366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92136e-a6f0-41b4-8710-25b8d1c01d54 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:09.117692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:09.119315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:09.203670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:09.203809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:09.204054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.204355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.205750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:09.208300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:09.223540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 908/1801] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:09.229987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:09.266919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283f76-01b3-4549-a960-cdc234fd0d4f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:09.282366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:09.283537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:09.289930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.289930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] PATH_INFO: `/v3/projects/d6916620fd144ecc8a6de7280043aa0f/users/37596afa0d354755a6d2fb82281f9689/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.321906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6916620fd144ecc8a6de7280043aa0f, user_id=37596afa0d354755a6d2fb82281f9689, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:09.333159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:09.429841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 894/1802] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:09.438389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:09.440359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:09.488517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:09.490841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 909/1803] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:09 2022] PUT /identity/v3/projects/d6916620fd144ecc8a6de7280043aa0f/users/37596afa0d354755a6d2fb82281f9689/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:09.491818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:09.494532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:09.558609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af5fa-c20b-470b-bceb-7578b3b49c05 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:09.630784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:09.644967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:09.647162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:09.647511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.647891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.708235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac7fd6-1c1b-4e73-bc27-bb1ac0debb5c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:09.723742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:09.731632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:09.731632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.731632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] PATH_INFO: `/v3/projects/e7587dd7ee1a4b1ab739db6096f21d7c` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.731632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7587dd7ee1a4b1ab739db6096f21d7c)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:09.739538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:09.799466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:09.803540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:09.822170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 895/1804] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:09.823328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:09.847368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a63c-92c3-420c-a5df-4b5bb8ebed86 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:09.875763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:09.875763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:09.875763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:09.875763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:09.884907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:09.887136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:09.907573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 896/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:09.918752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:09.950099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7587dd7ee1a4b1ab739db6096f21d7c', 'request_id': 'req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:09.960760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7587dd7ee1a4b1ab739db6096f21d7c', 'request_id': 'req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:09.992648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f5f-755e-4d70-8024-66d0824351b9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:10.037653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7587dd7ee1a4b1ab739db6096f21d7c', 'request_id': 'req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.055563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] The token cache is being invalidate because project e7587dd7ee1a4b1ab739db6096f21d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:10.055902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.057552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.059569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 910/1806] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:09 2022] DELETE /identity/v3/projects/e7587dd7ee1a4b1ab739db6096f21d7c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:10.070756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:10.072444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:10.106119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:10.107554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:10.108127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:10.109100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] PATH_INFO: `/v3/projects/d6916620fd144ecc8a6de7280043aa0f/users/37596afa0d354755a6d2fb82281f9689/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:10.112023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6916620fd144ecc8a6de7280043aa0f, user_id=37596afa0d354755a6d2fb82281f9689, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:10.115306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b7e9-5244-4bf5-b6be-4a8b63fbec00 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:10.142601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 897/1807] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:09 2022] PUT /identity/v3/projects/d6916620fd144ecc8a6de7280043aa0f/users/37596afa0d354755a6d2fb82281f9689/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:10.157195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:10.157554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:10.157845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:10.191348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b0c6-cd30-45cd-a840-4d1ae10fe552 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:10.198844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] MFA Rules not processed for user `37596afa0d354755a6d2fb82281f9689`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:10.200519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:10.361134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:10.363151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:10.363748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:10.364062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] PATH_INFO: `/v3/users/8e111aa6140b4a7e80c56aedbd02dd71` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:10.365748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e111aa6140b4a7e80c56aedbd02dd71)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:10.367929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:10.371010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 898/1808] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:10.382985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:10.389461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:10.497673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c221-beb2-4376-a68c-1a2eb3b147d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:10.503064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:10.503922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:10.504131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:10.504275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:10.506930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:10.584425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:10.585910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:10.599371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 899/1809] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:10.757352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e111aa6140b4a7e80c56aedbd02dd71'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.759704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e111aa6140b4a7e80c56aedbd02dd71'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.761352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e111aa6140b4a7e80c56aedbd02dd71'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.784550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e111aa6140b4a7e80c56aedbd02dd71'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:10.797474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-023d965e-ed27-4999-88fc-46216016cace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e111aa6140b4a7e80c56aedbd02dd71'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.091224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:11.092701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:11.109126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 911/1810] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:10 2022] DELETE /identity/v3/users/8e111aa6140b4a7e80c56aedbd02dd71 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:11.151369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92969dd0-f762-4c6f-b145-5e5d5f74d9fb service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:11.264124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:11.265083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:11.266675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.266957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.267233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] PATH_INFO: `/v3/projects/f0216b5fbc2a4456bd139fc18724f073` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.269028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0216b5fbc2a4456bd139fc18724f073)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:11.277055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:11.425717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0216b5fbc2a4456bd139fc18724f073', 'request_id': 'req-718fb611-9a18-4e93-a630-9d65c862488e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.433157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0216b5fbc2a4456bd139fc18724f073', 'request_id': 'req-718fb611-9a18-4e93-a630-9d65c862488e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.440243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0216b5fbc2a4456bd139fc18724f073', 'request_id': 'req-718fb611-9a18-4e93-a630-9d65c862488e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.537222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] The token cache is being invalidate because project f0216b5fbc2a4456bd139fc18724f073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:11.537491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.538156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-718fb611-9a18-4e93-a630-9d65c862488e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:11.543269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 900/1811] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:11 2022] DELETE /identity/v3/projects/f0216b5fbc2a4456bd139fc18724f073 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:11.549517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.550553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.550944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.575520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:11.577078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:11.655741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 912/1812] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:11.663424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.663890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.664363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.691588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:11.694516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:11.703087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 901/1813] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:11.706611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:11.717117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe06e-16c3-439d-b256-fbed2c79c711 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:11.722455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:11.723231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.723708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.724071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.725163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:11.725620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:11.729401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:11.749493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 913/1814] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:11.750967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:11.760828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8acfc-a087-4943-aa14-78c7bb241f2b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:11.766783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:11.768172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.768172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.768172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.768921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:11.771029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:11.894885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:11.897914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 902/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:11 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:11.902086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:11.904189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:11.920352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3703eaf-9bb0-4e80-8a9b-a4c7bbe70e71 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:11.976953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709c07-a3ae-40b6-afeb-3f34002db8b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:11.981469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:11.982135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.982413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.982595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:11.982741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.983405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:11.983512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:11.983742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:11.984021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] PATH_INFO: `/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:11.986365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46a0df95bc24f51a8c8bd66fbde5a21)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:11.986939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:11.988318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.064553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 903/1816] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:11 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:12.068848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.078735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd559b-1658-43cb-80b2-cbd815ee0eff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.088101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46a0df95bc24f51a8c8bd66fbde5a21', 'request_id': 'req-1b43741c-09f5-4082-a8be-ddeca8dedf08'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:12.095473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46a0df95bc24f51a8c8bd66fbde5a21', 'request_id': 'req-1b43741c-09f5-4082-a8be-ddeca8dedf08'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:12.136319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.137031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.137315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.137597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.138328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.140003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.150177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 904/1817] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:12.154009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.164169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460707e-ea3b-4e38-9c27-36778ea14f03 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.169106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.169737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.170060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.170340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.171047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.171532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46a0df95bc24f51a8c8bd66fbde5a21', 'request_id': 'req-1b43741c-09f5-4082-a8be-ddeca8dedf08'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:12.173116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.186457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 905/1818] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:12.186622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] The token cache is being invalidate because project b46a0df95bc24f51a8c8bd66fbde5a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:12.186622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:12.186622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1b43741c-09f5-4082-a8be-ddeca8dedf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:12.186886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 914/1819] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:11 2022] DELETE /identity/v3/projects/b46a0df95bc24f51a8c8bd66fbde5a21 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:12.187765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.189552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:12.191357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c3b9e-2569-4f31-a368-198d4f558f00 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.191661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c3b9e-2569-4f31-a368-198d4f558f00 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.191969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c3b9e-2569-4f31-a368-198d4f558f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.202416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1033ac-c342-4d11-afd9-4bf805329257 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.208949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.209888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.210165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.210482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] PATH_INFO: `/v3/projects/139f68e6708447249f1e97dd27f613fe/users/9e9c61eaf12b4a539986a2e8b96e7e21/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.210725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ae8c3b9e-2569-4f31-a368-198d4f558f00 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:12.211933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ae8c3b9e-2569-4f31-a368-198d4f558f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:12.220984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:12.226981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139f68e6708447249f1e97dd27f613fe, user_id=9e9c61eaf12b4a539986a2e8b96e7e21, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.229593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.229886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.230011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa053193-c4e2-46f8-85a0-ad2e7d1421f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.230164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.247946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:12.249177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:12.257572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 916/1821] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:12.261517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.276721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198b1d-da93-4841-9510-23e5e2382a8a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.276855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.277572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.277856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.278130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.278848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:12.279206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.281040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.297685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 917/1822] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:12.305352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.310091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14936-5d35-4341-aef2-8215352fdfc8 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.315901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.316687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.317090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.317596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.318363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.320433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.332583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 906/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:12 2022] PUT /identity/v3/projects/139f68e6708447249f1e97dd27f613fe/users/9e9c61eaf12b4a539986a2e8b96e7e21/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:12.335245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.335541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.335818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.355142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:12.362321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:12.421064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 907/1824] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:12.431256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.432824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:12.462309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 918/1825] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:12.466099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.515216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6402b-3606-4237-b921-7eee41b3586e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.543271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba29fb-1dcd-41d8-abae-8c670c511618 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.547992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.548708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.548993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.549270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.549964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.552805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.557096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:12.572883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.573542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.573828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.574107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.583977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.585449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.595467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 908/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:12.663703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 919/1827] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:12.667875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.678552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194a02-83e5-47cb-8694-f68211c5e5b1 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.683375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.684114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.684468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.684781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.685508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.687133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.697268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 909/1828] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:12.701206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.712092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53652910-83e5-4657-981f-2d3e578e4dd7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.716895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.717565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.717851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.718182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.719787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.721085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1716d-79d4-4acf-866f-55c0efe9ac90 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.731545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 920/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:12.737407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:12.748198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a818-52c4-48ed-bc71-2711c73343ad admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:12.753372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:12.757776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.757776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.757776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] PATH_INFO: `/v3/projects/b2010e9b90ba43a493d2b854f10e1d62/users/a90736991848460da2286370360892a5/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.772512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2010e9b90ba43a493d2b854f10e1d62, user_id=a90736991848460da2286370360892a5, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:12.776252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:12.865030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 910/1830] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:12 2022] PUT /identity/v3/projects/b2010e9b90ba43a493d2b854f10e1d62/users/a90736991848460da2286370360892a5/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:12.876227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:12.876572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:12.876831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:12.913468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] MFA Rules not processed for user `a90736991848460da2286370360892a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:12.915127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:13.035124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 921/1831] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:13.039743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.102613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f58532-18a7-46d1-8d93-5d78dabe8234 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.107880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.109890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.110622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.111094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.112392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.115481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.207649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 911/1832] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:13 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:13.211196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.225580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234d3f-d5b9-425d-a64f-88991d831b37 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.299311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.300362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.300909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.301424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.303390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.305833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.405015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 922/1833] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:13 2022] POST /identity/v3/users => generated 306 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:13.406264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.416597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5870-8488-4208-b3f4-e55449b39f8b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.421590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.422398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.422623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.422935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.423666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.425347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.436755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 912/1834] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:13.442024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.452932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1d09-c90e-4b2e-9fe8-8bfdf93b06a1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.459705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.462065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.462065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.462274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] PATH_INFO: `/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1/users/a91d59edbc8842bdbe3535650119283f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.481066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80270e29cbc4c05b76c0ba682ca5dd1, user_id=a91d59edbc8842bdbe3535650119283f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.488575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.614980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 923/1835] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:13 2022] PUT /identity/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1/users/a91d59edbc8842bdbe3535650119283f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:13.619347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.630912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0b00-d419-4c72-a3a8-04f5c90ab2cc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.699559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:13.701793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.702651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.707684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.708248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.709330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.711603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42fd6-1adb-4f3f-a743-1bc4171d344f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.725925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 913/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:13.730199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.754101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6096812-8e20-4c70-aabb-fb16add54eb2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:13.769605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:13.770637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.770844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.771123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] PATH_INFO: `/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1/users/a91d59edbc8842bdbe3535650119283f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.773221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80270e29cbc4c05b76c0ba682ca5dd1, user_id=a91d59edbc8842bdbe3535650119283f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:13.775874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:13.788248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 924/1837] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:13 2022] PUT /identity/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1/users/a91d59edbc8842bdbe3535650119283f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:13.801799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d37c7-02f5-4ec3-92c3-028ecfdadc8e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:13.802464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d37c7-02f5-4ec3-92c3-028ecfdadc8e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:13.803045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d37c7-02f5-4ec3-92c3-028ecfdadc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:13.831189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0c9d37c7-02f5-4ec3-92c3-028ecfdadc8e None None] MFA Rules not processed for user `a91d59edbc8842bdbe3535650119283f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:13.832575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c9d37c7-02f5-4ec3-92c3-028ecfdadc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:13.908642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 914/1838] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:13.927597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:13.977709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:13.979656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:14.041281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d7e2-1ac6-4eac-9239-fbceeb346224 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.045012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.045670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.045956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.046233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.064528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.066158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:14.078774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 925/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:14.251110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.251551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.251730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.286769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] MFA Rules not processed for user `9e9c61eaf12b4a539986a2e8b96e7e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:14.288229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:14.356552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 915/1840] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:14.361499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:14.429576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:14.439911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ff6b5-0031-4640-99e7-f5221cca91c1 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.440094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c37fe-8ce3-4289-9b0f-3d1587b2411f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.443911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.444544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.444712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.445163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.445270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.445489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.445581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.445792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.446552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.448478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:14.505466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.506948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:14.517010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 916/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:14.586435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 926/1842] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:14 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:14.590455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:14.601898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61994-dcaa-46e6-8d6b-1618df420aec service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.661124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.661764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.662047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.662329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.663067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.665016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:14.761980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:14.827201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 917/1843] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:14 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:14.830555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:14.841986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd3be-0102-4168-b201-84c4508afa08 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.847760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.847932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.848239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.848514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.849251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.850956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:14.864948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 927/1844] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:14.868116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:14.879865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b55d9-9baf-4c5a-a5e6-603fc52c7828 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:14.885654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:14.897423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:14.897423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:14.897423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] PATH_INFO: `/v3/projects/5ede5c15586d45f1bc5896cbc9f38821/users/28b12234cbe34087b0cdcde421b57aae/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:14.905641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ede5c15586d45f1bc5896cbc9f38821, user_id=28b12234cbe34087b0cdcde421b57aae, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:14.909090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:15.003308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 918/1845] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:14 2022] PUT /identity/v3/projects/5ede5c15586d45f1bc5896cbc9f38821/users/28b12234cbe34087b0cdcde421b57aae/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:15.009866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:15.020685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dea61-8fa6-4c3f-972f-0aa3581fc6c8 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:15.080102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:15.080889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:15.081271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:15.081654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:15.082591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:15.084196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd0af9-b48c-4f0f-be82-75c03490e290 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:15.094738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 928/1846] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:15.099314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:15.110410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7762-3de2-4ef0-aac0-b7ba0093279a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:15.114947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:15.115820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:15.116096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:15.116366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] PATH_INFO: `/v3/projects/5ede5c15586d45f1bc5896cbc9f38821/users/28b12234cbe34087b0cdcde421b57aae/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:15.118333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ede5c15586d45f1bc5896cbc9f38821, user_id=28b12234cbe34087b0cdcde421b57aae, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:15.121081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:15.131457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 919/1847] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:15 2022] PUT /identity/v3/projects/5ede5c15586d45f1bc5896cbc9f38821/users/28b12234cbe34087b0cdcde421b57aae/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:15.377171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:17.299541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:17.300126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:17.300126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:17.340159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] MFA Rules not processed for user `28b12234cbe34087b0cdcde421b57aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:17.341738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:17.429449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 929/1848] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:17.444103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:17.505256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2b9bc-af5c-481a-9ce2-f370fca1d1de admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:17.509221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:17.509868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:17.515758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:17.515758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:17.572941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:17.574387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:17.584214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 920/1849] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:17.624110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:18.023976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:18.493885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:18.613146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:18.835649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:18.927208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.045552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.264078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.321356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.467959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.515130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.575550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:19.577082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:19.590516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b777e-d973-46e7-9983-ac528819e7d1 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:19.595106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:19.596229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:19.596613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:19.596897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:19.599167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:19.663400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:19.676471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:19.678031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0022103-38ca-40c6-9917-9724442ea0d9 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:19.687907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 930/1850] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:21.388765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:21.397769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68467a-384d-4c35-9e6e-4758eafd6b8e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:21.401818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:21.402503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:21.402820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:21.403098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:21.413065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:21.414495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cc78c-a75d-4122-b724-071cf4c83266 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:21.424159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 921/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:29.801191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=61 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:30.981050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.981711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.981711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.983095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 931/1852] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:30.996807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.998196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.998508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.021807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:31.023014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:31.060807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:31.100818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 922/1853] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:36:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:31.207524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:31.209279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:31.229954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248c33-a217-4cbf-be40-6474f92f5725 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:31.237192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:31.237192 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:31.237484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:31.237769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.247600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:31.249299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd3427-8678-4ecd-be2b-ec51ea72738d service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:31.261067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 932/1854] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:41.183272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=14 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:41.256510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:42.493498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:42.595199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fa1a8-4f07-4881-aba2-3cd8fd1fcfe7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:42.599844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:42.600855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:42.601261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:42.601563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] PATH_INFO: `/v3/users/a90736991848460da2286370360892a5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:42.602759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90736991848460da2286370360892a5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:42.604810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:42.883172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90736991848460da2286370360892a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:42.883833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90736991848460da2286370360892a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:42.884438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90736991848460da2286370360892a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:42.896145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90736991848460da2286370360892a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:42.904169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90736991848460da2286370360892a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:43.040894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 923/1855] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:42 2022] DELETE /identity/v3/users/a90736991848460da2286370360892a5 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:43.045567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.046028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.046122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.065010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:43.066230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:43.126559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 933/1856] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:43.137755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.139163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:43.197606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01397e2-c652-4966-82cc-2956f368be1f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.201187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.201835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.202118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.202395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.211928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.213397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.222863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 924/1857] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:43.791940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.795577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:43.820477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ff3a-6f96-4bbd-a4ee-e71f42dd70fd None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.827297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.828231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.828717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.829147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] PATH_INFO: `/v3/projects/b2010e9b90ba43a493d2b854f10e1d62` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.830546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2010e9b90ba43a493d2b854f10e1d62)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.833035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.974116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2010e9b90ba43a493d2b854f10e1d62', 'request_id': 'req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:43.989723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2010e9b90ba43a493d2b854f10e1d62', 'request_id': 'req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.154077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2010e9b90ba43a493d2b854f10e1d62', 'request_id': 'req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.166072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] The token cache is being invalidate because project b2010e9b90ba43a493d2b854f10e1d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:44.166359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.166989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.168575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 934/1858] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:43 2022] DELETE /identity/v3/projects/b2010e9b90ba43a493d2b854f10e1d62 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:44.172841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:44.183141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878661ff-4539-464f-824c-31aa1e7a1751 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:44.201599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:44.240087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:44.241450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:44.241733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:44.242011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] PATH_INFO: `/v3/users/a91d59edbc8842bdbe3535650119283f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:44.243330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91d59edbc8842bdbe3535650119283f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:44.245285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:44.511416 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91d59edbc8842bdbe3535650119283f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.512089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91d59edbc8842bdbe3535650119283f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.512734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91d59edbc8842bdbe3535650119283f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.525118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91d59edbc8842bdbe3535650119283f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.532183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91d59edbc8842bdbe3535650119283f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:44.703413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 925/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:44 2022] DELETE /identity/v3/users/a91d59edbc8842bdbe3535650119283f => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:45.294426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:45.296221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:45.312821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b96b-f1a9-442b-a7fb-b63ff6c0c155 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:45.381271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:45.382329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.382613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.382890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] PATH_INFO: `/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.384255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80270e29cbc4c05b76c0ba682ca5dd1)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:45.386229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:45.592810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:45.594271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:45.608073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c8e-a03a-4c32-a928-1b4eb914e571 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:45.608237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:45.614191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:45.615212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.615793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.616275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] PATH_INFO: `/v3/users/ff90011cb5e843438ec0019fd7587bd5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.617621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff90011cb5e843438ec0019fd7587bd5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:45.624604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:45.627751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80270e29cbc4c05b76c0ba682ca5dd1', 'request_id': 'req-80d66ae3-ea33-4366-802a-4866001e313f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.633932 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80270e29cbc4c05b76c0ba682ca5dd1', 'request_id': 'req-80d66ae3-ea33-4366-802a-4866001e313f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.708636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80270e29cbc4c05b76c0ba682ca5dd1', 'request_id': 'req-80d66ae3-ea33-4366-802a-4866001e313f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.720759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] The token cache is being invalidate because project e80270e29cbc4c05b76c0ba682ca5dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:45.721041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.721676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-80d66ae3-ea33-4366-802a-4866001e313f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.723223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 935/1860] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:45 2022] DELETE /identity/v3/projects/e80270e29cbc4c05b76c0ba682ca5dd1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:45.728802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ce3b-4db7-4f29-94de-1924fcc6e07a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.729100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ce3b-4db7-4f29-94de-1924fcc6e07a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.729514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ce3b-4db7-4f29-94de-1924fcc6e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.749520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4d16ce3b-4db7-4f29-94de-1924fcc6e07a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:45.750996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4d16ce3b-4db7-4f29-94de-1924fcc6e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:45.811097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 936/1861] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:45.820704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.820704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.821387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.828813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff90011cb5e843438ec0019fd7587bd5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.829645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff90011cb5e843438ec0019fd7587bd5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.830268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff90011cb5e843438ec0019fd7587bd5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.843095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:45.844422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff90011cb5e843438ec0019fd7587bd5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.844674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:45.853340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 937/1862] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:45.858434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:45.862098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8b611419-bbf3-4c5d-989a-f6b906979879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff90011cb5e843438ec0019fd7587bd5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:45.868312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f6bd1-bae2-4b51-bba1-1f45c3ca25b3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:45.872995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:45.873651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.873936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.874211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.874936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:45.875254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:45.876869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:45.889576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 938/1863] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:45.893748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:45.908523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441692-eac8-474f-9d14-fc834227cd13 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:45.918175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:45.919022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.919299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.919570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.920352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:45.922463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:45.958280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 926/1864] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:45 2022] DELETE /identity/v3/users/ff90011cb5e843438ec0019fd7587bd5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:45.962371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:45.962832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:45.963351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:45.993651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:45.995013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:46.005880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:46.033901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 939/1865] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:45 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:46.039080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.073272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 927/1866] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:46.084795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.087928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:46.123281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a3c0-8058-40a1-b5a3-583b5b1a0427 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.130075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.131223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.131613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.131921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.132871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.135895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.158144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2ed03-90d7-42b9-bb7f-06598ddaf656 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.221932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.222803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.223092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.223507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.240204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 940/1867] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:46 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:46.244595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.245539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.247000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.250143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:46.258058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67c24-3888-4e0e-b4cd-d51ba7b28ec1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.259253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 928/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:36:46.263472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.264151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.264434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.264742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.265477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.267238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.290489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 941/1869] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:46.294587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.306063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebd42-3026-40bf-98e6-1a6689ef7c1a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.312228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.313532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.313822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.314093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.315491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.317913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde47a7-802a-436f-967f-fc48d510bbaf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.332662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 929/1870] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:46.337436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.369820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0744d-fd85-4f71-837e-9ea396d79550 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.375659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.376597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.376871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.377325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] PATH_INFO: `/v3/projects/bdd13eb647d34162baf0f066acdf4b29/users/f837783840e94cbc881fea70ac368d5b/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.393746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd13eb647d34162baf0f066acdf4b29, user_id=f837783840e94cbc881fea70ac368d5b, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.396461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.481880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 942/1871] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:46 2022] PUT /identity/v3/projects/bdd13eb647d34162baf0f066acdf4b29/users/f837783840e94cbc881fea70ac368d5b/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:46.498143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.498793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.499446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.557780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] MFA Rules not processed for user `f837783840e94cbc881fea70ac368d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:46.559107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:46.618675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:46.637338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 930/1872] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:46.641700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.708585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bbf7-4461-4640-9d5d-32a07403149e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.714211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.714873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.715153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.715427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.716112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.718063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.761088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.762536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:46.777876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326c7d-620b-4004-8b3c-d9dea5e57ce1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.782699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.783563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.783844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.784222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] PATH_INFO: `/v3/projects/14e30f8d3f9042b8a7347c381a737f4e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.785355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e30f8d3f9042b8a7347c381a737f4e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.787568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.841396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 943/1873] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:46 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:46.845415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.906014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fe204-b88c-44b6-b0df-4770535bc7e6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.910731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.911404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.913814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.913814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.913814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:46.914733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:46.954507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e30f8d3f9042b8a7347c381a737f4e', 'request_id': 'req-046041ef-5a42-4645-874d-a458142931c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:46.960660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e30f8d3f9042b8a7347c381a737f4e', 'request_id': 'req-046041ef-5a42-4645-874d-a458142931c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:46.966145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e30f8d3f9042b8a7347c381a737f4e', 'request_id': 'req-046041ef-5a42-4645-874d-a458142931c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.029634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 944/1874] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:46 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:36:47.033364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.044022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12410d-b257-4716-b35b-ff8f8fc83a4c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.056332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] The token cache is being invalidate because project 14e30f8d3f9042b8a7347c381a737f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:47.056728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.057443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.059054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 931/1875] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:46 2022] DELETE /identity/v3/projects/14e30f8d3f9042b8a7347c381a737f4e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:47.062960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.064318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.085625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:47.102860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.103477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.103762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.104042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.104827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.106437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.119823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 945/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:47.120969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.122609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.130283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046041ef-5a42-4645-874d-a458142931c2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.135028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf57ae-12e1-4258-b7da-ef431213a1b1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.135220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.136094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.136372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.136678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] PATH_INFO: `/v3/users/7c357a73ab3b42e48be3012528a3a9ef` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.137881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c357a73ab3b42e48be3012528a3a9ef)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.139808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.140136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.140952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.141247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.141982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] PATH_INFO: `/v3/projects/5ee8d236e9d648f68af463417190b262/users/ff0d184e170f46b88b069402e90eb714/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.158184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee8d236e9d648f68af463417190b262, user_id=ff0d184e170f46b88b069402e90eb714, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.160970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.292582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 946/1877] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:47 2022] PUT /identity/v3/projects/5ee8d236e9d648f68af463417190b262/users/ff0d184e170f46b88b069402e90eb714/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:47.296017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.351913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c357a73ab3b42e48be3012528a3a9ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.352840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c357a73ab3b42e48be3012528a3a9ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.353682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c357a73ab3b42e48be3012528a3a9ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.364864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2192-990d-4ea2-ab5a-47bc5e3f12ae admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.368597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c357a73ab3b42e48be3012528a3a9ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.369761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.370445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.370856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.371139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.371868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.373492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.377365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c357a73ab3b42e48be3012528a3a9ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:47.381553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:47.388582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 947/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:47.389753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.391996 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.405257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a94af-78e5-4b35-b58e-59a4b4499c5f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.410098 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.410998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.411278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.411556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] PATH_INFO: `/v3/projects/5ee8d236e9d648f68af463417190b262/users/ff0d184e170f46b88b069402e90eb714/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.413713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee8d236e9d648f68af463417190b262, user_id=ff0d184e170f46b88b069402e90eb714, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.416432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e908e5-5dc6-4cf9-8d41-11a70f41a36b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.432563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 948/1879] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:47 2022] PUT /identity/v3/projects/5ee8d236e9d648f68af463417190b262/users/ff0d184e170f46b88b069402e90eb714/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:47.446544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.446828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.447102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.484760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] MFA Rules not processed for user `ff0d184e170f46b88b069402e90eb714`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:47.486169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.496946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 932/1880] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:47 2022] DELETE /identity/v3/users/7c357a73ab3b42e48be3012528a3a9ef => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:47.570671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 949/1881] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:47.582632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.584269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.663636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168c187-0dfd-4c43-ad9e-972f4e63506d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.667682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.668329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.668667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.668942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.670740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:47.735258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.736772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acb47-4fc3-468e-9cf9-79ce7cc2cda8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.746235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 933/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:48.018191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.019650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:48.056883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.098218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34adc7-3c96-4d86-b36a-15e99d7199b6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.157728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.158606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.158890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.159169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] PATH_INFO: `/v3/projects/3ebeecf729d140d2b1b49a457459612b` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.160358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebeecf729d140d2b1b49a457459612b)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.162987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.309371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebeecf729d140d2b1b49a457459612b', 'request_id': 'req-a5415027-aa6f-4588-a91b-9928b73ae29d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:48.315689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebeecf729d140d2b1b49a457459612b', 'request_id': 'req-a5415027-aa6f-4588-a91b-9928b73ae29d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:48.490265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebeecf729d140d2b1b49a457459612b', 'request_id': 'req-a5415027-aa6f-4588-a91b-9928b73ae29d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:48.546839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] The token cache is being invalidate because project 3ebeecf729d140d2b1b49a457459612b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:48.547679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:48.549105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a5415027-aa6f-4588-a91b-9928b73ae29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:48.551486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 950/1883] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:48 2022] DELETE /identity/v3/projects/3ebeecf729d140d2b1b49a457459612b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:48.557270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.557709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.558360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.582565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:48.584816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:48.709938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 934/1884] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:48.712771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.713591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.714092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.754402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:48.756305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:48.767694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 951/1885] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:48.772864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.785699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcd80f-9d44-4ffb-9153-cce39dd8c433 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.791080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.791850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.794995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.794995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.794995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:48.794995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.796067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.812927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 935/1886] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:48.816657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.828772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e09d-1278-40cd-a775-cbc8226a4c7e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.835677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.836358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.840419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.840419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.840419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.840419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.011404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 952/1887] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:48 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:49.015626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.028141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45f67-6d23-4ab7-bf6d-dcfd5fcbecea admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.073173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:49.102215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.103041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.103324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.103597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.104284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.106317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.237816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 936/1888] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:49 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:49.239033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.250585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8226-8e03-4438-ab26-463fb5ad85b6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.257106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.257813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.258243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.258979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.260219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.267558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.275638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 953/1889] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:49.279528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.291119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729cddf-3904-41b2-9402-cb073f554252 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.296803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.297947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.298532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.299068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.300273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.303349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b0e-c2a5-4283-a10f-45f11092810a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.315417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 937/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:49.320832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.331652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49365-6d3e-445b-a9b3-9f73d45be807 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.337894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.338782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.339065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.339343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] PATH_INFO: `/v3/projects/f6d5063786634f80b42579be2d9f75d2/users/bca22e6d2cd649309b2568fea777c811/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.355812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d5063786634f80b42579be2d9f75d2, user_id=bca22e6d2cd649309b2568fea777c811, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.360236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.364044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:49.455843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 954/1891] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:49 2022] PUT /identity/v3/projects/f6d5063786634f80b42579be2d9f75d2/users/bca22e6d2cd649309b2568fea777c811/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:49.467202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.467529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.467812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.498571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] MFA Rules not processed for user `bca22e6d2cd649309b2568fea777c811`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:49.499904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:49.578281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 938/1892] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:49.582836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.655056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bc4a-6d1d-462a-b9c0-985bc9d4e05c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.659853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.660540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.660822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.661548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.661856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.664920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.779239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 955/1893] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:49 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:49.781381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.801406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b01172-c0b9-4d14-874f-d36f75c81a67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.901268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.902385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.903275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.904107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.905173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.915604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.098601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 939/1894] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:49 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:50.104371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:50.121039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da640-dfcb-4600-988b-b4f8b0680597 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:50.127429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:50.129095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.129512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.130074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.131488 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:50.155489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.168574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 956/1895] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:50.172918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:50.189724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f87a-8841-4459-a730-4f8c623f8f66 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:50.196282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:50.197336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.197927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.198304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] PATH_INFO: `/v3/projects/50906c6771dc4807a470c4c6679bf489/users/9699196e69224df58cada9d8a6e53936/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.231593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50906c6771dc4807a470c4c6679bf489, user_id=9699196e69224df58cada9d8a6e53936, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:50.236378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.377818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 940/1896] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:50 2022] PUT /identity/v3/projects/50906c6771dc4807a470c4c6679bf489/users/9699196e69224df58cada9d8a6e53936/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:36:50.383844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:50.394877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e98-1dd1-4ebd-98b2-d2711eafe36e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:50.467839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:50.468395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.468716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.468995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.469750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:50.471776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8759374-aa39-4b4e-b754-8b9043f8d740 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.486739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 957/1897] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:50.492565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:50.505171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910768a-ebad-4f04-b524-55de136a5694 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:50.511356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:50.512714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.512999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.513278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] PATH_INFO: `/v3/projects/50906c6771dc4807a470c4c6679bf489/users/9699196e69224df58cada9d8a6e53936/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.515394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50906c6771dc4807a470c4c6679bf489, user_id=9699196e69224df58cada9d8a6e53936, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:50.519123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.524235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:50.536625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 941/1898] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:50 2022] PUT /identity/v3/projects/50906c6771dc4807a470c4c6679bf489/users/9699196e69224df58cada9d8a6e53936/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:50.548513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.548757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.549034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.600920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] MFA Rules not processed for user `9699196e69224df58cada9d8a6e53936`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:50.604454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:50.684741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:50.704829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 958/1899] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:50.725893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:50.729092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:50.827620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8436-e107-4afa-87a8-736aaef401f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:50.831706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:50.832799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:50.832924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:50.833226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:50.845218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:50.847153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74876f5e-d889-44f1-a9c1-7f4a4d10319d service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:50.864102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 942/1900] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:55.434798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:55.496954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cbd7-5771-4017-8bf0-1ac94133d1aa None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:55.501555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:55.502430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:55.502732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:55.502992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] PATH_INFO: `/v3/users/bca22e6d2cd649309b2568fea777c811` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:55.504189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca22e6d2cd649309b2568fea777c811)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:55.506694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:55.738756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca22e6d2cd649309b2568fea777c811'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:55.739390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca22e6d2cd649309b2568fea777c811'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:55.740011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca22e6d2cd649309b2568fea777c811'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:55.751679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca22e6d2cd649309b2568fea777c811'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:55.759222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca22e6d2cd649309b2568fea777c811'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:55.833429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 959/1901] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:55 2022] DELETE /identity/v3/users/bca22e6d2cd649309b2568fea777c811 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:55.838514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:55.839178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:55.839350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:55.863395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:55.865212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:55.925778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 943/1902] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:55.936068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:55.937581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:55.998425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da704-c027-40ae-9b80-0328704c5dae admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.002000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:56.002641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.002931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.003206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.012854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:56.014281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:56.023726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 960/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:36:56.675537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:56.677044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:56.700318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692a84a-17f9-4e63-a7a2-71a0de66bb34 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.705079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:56.705988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.706168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.706439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] PATH_INFO: `/v3/projects/f6d5063786634f80b42579be2d9f75d2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.707618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d5063786634f80b42579be2d9f75d2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:56.712462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:56.839790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d5063786634f80b42579be2d9f75d2', 'request_id': 'req-e4040e6a-e765-413a-80b7-dd77adada159'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:56.846022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d5063786634f80b42579be2d9f75d2', 'request_id': 'req-e4040e6a-e765-413a-80b7-dd77adada159'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:56.852614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d5063786634f80b42579be2d9f75d2', 'request_id': 'req-e4040e6a-e765-413a-80b7-dd77adada159'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:56.941591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] The token cache is being invalidate because project f6d5063786634f80b42579be2d9f75d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:56.941881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:56.942501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:56.944793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 944/1904] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:56 2022] DELETE /identity/v3/projects/f6d5063786634f80b42579be2d9f75d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:56.948805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:56.958379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461dff-9854-46f3-a96f-715e371765ba service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.968578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:57.016219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:57.017140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:57.017421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:57.017727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] PATH_INFO: `/v3/users/9699196e69224df58cada9d8a6e53936` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:57.018876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9699196e69224df58cada9d8a6e53936)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:57.021036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:57.230274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9699196e69224df58cada9d8a6e53936'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:57.230963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9699196e69224df58cada9d8a6e53936'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:57.231702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9699196e69224df58cada9d8a6e53936'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:57.244822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9699196e69224df58cada9d8a6e53936'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:57.251866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-7ca3a828-d319-49b5-a106-d3cae8201bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9699196e69224df58cada9d8a6e53936'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:57.319599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 961/1905] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:36:56 2022] DELETE /identity/v3/users/9699196e69224df58cada9d8a6e53936 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:57.798171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:57.799603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:57.815177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040e6a-e765-413a-80b7-dd77adada159 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:57.839398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:57.880333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:57.881699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:57.882042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:57.882383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] PATH_INFO: `/v3/projects/50906c6771dc4807a470c4c6679bf489` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:57.883648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50906c6771dc4807a470c4c6679bf489)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:57.885690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.053998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50906c6771dc4807a470c4c6679bf489', 'request_id': 'req-0b861d3d-373b-40e9-9f98-faf9bad154b3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:58.060319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50906c6771dc4807a470c4c6679bf489', 'request_id': 'req-0b861d3d-373b-40e9-9f98-faf9bad154b3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:58.066269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50906c6771dc4807a470c4c6679bf489', 'request_id': 'req-0b861d3d-373b-40e9-9f98-faf9bad154b3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:58.216220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] The token cache is being invalidate because project 50906c6771dc4807a470c4c6679bf489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:36:58.217384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:58.218070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0b861d3d-373b-40e9-9f98-faf9bad154b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:36:58.220052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 945/1906] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:36:57 2022] DELETE /identity/v3/projects/50906c6771dc4807a470c4c6679bf489 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:58.233661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.233661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.233661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.244462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:58.245825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:58.305597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 962/1907] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:58.314207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.314495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.314773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.333709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:58.335948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:58.343891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 946/1908] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:36:58.348043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.358676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd593-2d65-490b-9f60-55b4889fb412 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.363845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.364547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.364836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.365116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.365845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:58.366153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.367762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.379614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 963/1909] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:58.384292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.393358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47e60-62d6-46d5-a401-a36bbf62c2fc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.398999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.399643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.399949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.400219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.400950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.402835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.542440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 947/1910] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:58 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:58.546655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.557380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a7c8-5c68-44a4-b69f-36b250fd5eac admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.573966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:58.614246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.615236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.616562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.617246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.618167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.620242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.745305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 964/1911] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:58 2022] POST /identity/v3/users => generated 304 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:58.747134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.758774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da15c-26f0-4713-85eb-1dde79b9f792 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.765457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.765925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.766222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.766499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.767298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.769263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.781345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 948/1912] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:58.785536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.799259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec577e9-0378-48d6-80b2-510b13587c59 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.806676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.807821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.808312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.808818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.809783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.811751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9c1f3-fb35-4799-ad6f-f0305c15a9f0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:58.824571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 965/1913] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:36:58.828132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:58.841129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100703-c8b9-4a1c-8e44-80758560cbfd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:58.849670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:58.851549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:58.852204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:58.852685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] PATH_INFO: `/v3/projects/50104f93fc114b3789c9c36b2a879537/users/96cf57e7d6e04151af4382ccd0afa22e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:58.873992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50104f93fc114b3789c9c36b2a879537, user_id=96cf57e7d6e04151af4382ccd0afa22e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:58.877087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.011169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 949/1914] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:58 2022] PUT /identity/v3/projects/50104f93fc114b3789c9c36b2a879537/users/96cf57e7d6e04151af4382ccd0afa22e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:59.022080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.023028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.023315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.066158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] MFA Rules not processed for user `96cf57e7d6e04151af4382ccd0afa22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:59.067394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:59.165982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 966/1915] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:36:59.170372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.220266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:59.233608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfe57-cbee-4a49-a81f-59fd9d4b7061 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.238450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.239098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.239374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.239645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.240552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.243366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.344507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 950/1916] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:59.348597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.359832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e47cd-cf9f-4205-8b40-23061d012778 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.416189 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.417016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.417378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.417728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.418502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.421295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.508781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 967/1917] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:59.512675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.524266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd812d21-f302-42fa-bf31-27615b029f8c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.529077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.529753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.530044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.530319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.531074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.532841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.544029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 951/1918] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:59.554132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.564208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253e5-9211-4054-aab5-c8e0d9b4f56d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.569629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.570513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.570799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.571074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] PATH_INFO: `/v3/projects/8e2fdc011efe4a7187714dd53d098b9e/users/b180fdc20dd64d6483f016fb882949cb/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.585902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2fdc011efe4a7187714dd53d098b9e, user_id=b180fdc20dd64d6483f016fb882949cb, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.588660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.590847 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:59.725978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 968/1919] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:59 2022] PUT /identity/v3/projects/8e2fdc011efe4a7187714dd53d098b9e/users/b180fdc20dd64d6483f016fb882949cb/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:59.730008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.741030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41dcc-d87d-431a-9339-53dba7e63970 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.797907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.798601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.798887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.799159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.799890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.801529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993a1a7-8df3-47a0-b7f6-8311b61283c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.815340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 952/1920] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:59.820123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.830642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a476855-d2d0-46d1-9f7c-f28a540f424a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.840305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.841245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.844541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.844541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] PATH_INFO: `/v3/projects/8e2fdc011efe4a7187714dd53d098b9e/users/b180fdc20dd64d6483f016fb882949cb/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.844541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2fdc011efe4a7187714dd53d098b9e, user_id=b180fdc20dd64d6483f016fb882949cb, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.846449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.857852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 969/1921] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:36:59 2022] PUT /identity/v3/projects/8e2fdc011efe4a7187714dd53d098b9e/users/b180fdc20dd64d6483f016fb882949cb/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:59.876788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.876788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.876788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.913740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] MFA Rules not processed for user `b180fdc20dd64d6483f016fb882949cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:59.915032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:59.970402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.972085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:59.990118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 953/1922] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:00.029405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:00.031115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:00.040018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae32fe-97ed-49c6-aedf-4209d830dd75 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:00.046221 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e549-7dc4-457f-8434-a9c7635319a1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:00.047377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:00.048062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:00.048345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:00.048652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:00.051815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:00.052671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:00.053886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:00.054174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:00.054456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:00.065299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:00.066875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:00.078666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 954/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:00.179508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:00.181107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:00.192656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 970/1924] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:36:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:01.259520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:01.268701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df704-9dc3-4f27-98be-ee53f9d555b7 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:01.272716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:01.273446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:01.273800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:01.274144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:01.312454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:01.343881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:01.345664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430bdf-af2a-4587-a726-0aa7911b33b2 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:01.354962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 955/1925] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:10.187529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:INSERT=2,keystone:SELECT=57 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:11.708068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=14 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:15.496472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:15.498617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:15.575056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22c83-b9fd-4a17-8e19-da02e6dcb61a service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:15.579920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:15.580834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:15.581114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:15.581393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] PATH_INFO: `/v3/users/4a5e5b3b83e349bc927fe9161b5a2e16` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:15.582593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5e5b3b83e349bc927fe9161b5a2e16)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:15.584693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:15.939469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5e5b3b83e349bc927fe9161b5a2e16'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:15.940203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5e5b3b83e349bc927fe9161b5a2e16'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:15.940850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5e5b3b83e349bc927fe9161b5a2e16'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:15.956816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5e5b3b83e349bc927fe9161b5a2e16'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:15.965300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5e5b3b83e349bc927fe9161b5a2e16'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:16.049823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 971/1926] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:15 2022] DELETE /identity/v3/users/4a5e5b3b83e349bc927fe9161b5a2e16 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:16.054544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:16.055073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:16.055345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:16.073922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:16.075264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:16.135764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 956/1927] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:16.146300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:16.150193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:16.211675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc005-c3ee-40d2-926c-0ac74eae3510 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:16.217844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:16.218942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:16.219843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:16.220114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:16.233923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:16.235585 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:16.251299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 972/1928] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:16.761024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:16.762621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:16.780678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578145-4072-454e-b305-fb809bd646e5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:16.785497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:16.786396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:16.787590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:16.787865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] PATH_INFO: `/v3/projects/1caffb5cdf564fe69571b6b9c16d923a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:16.799801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1caffb5cdf564fe69571b6b9c16d923a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:16.799801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:16.942451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1caffb5cdf564fe69571b6b9c16d923a', 'request_id': 'req-a7560fec-a064-4a66-b804-206f89359c6a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:16.951891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1caffb5cdf564fe69571b6b9c16d923a', 'request_id': 'req-a7560fec-a064-4a66-b804-206f89359c6a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:16.955674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1caffb5cdf564fe69571b6b9c16d923a', 'request_id': 'req-a7560fec-a064-4a66-b804-206f89359c6a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.072993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] The token cache is being invalidate because project 1caffb5cdf564fe69571b6b9c16d923a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:17.073606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.074205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.075806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 957/1929] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:16 2022] DELETE /identity/v3/projects/1caffb5cdf564fe69571b6b9c16d923a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:17.079743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:17.089725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d2310-81fe-4cf5-b762-657e443895c9 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:17.107871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:17.145376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:17.146304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:17.146561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:17.146836 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] PATH_INFO: `/v3/users/37596afa0d354755a6d2fb82281f9689` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:17.148032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37596afa0d354755a6d2fb82281f9689)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:17.149985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:17.487152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37596afa0d354755a6d2fb82281f9689'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.487735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37596afa0d354755a6d2fb82281f9689'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.488329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37596afa0d354755a6d2fb82281f9689'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.500999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37596afa0d354755a6d2fb82281f9689'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.512871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2ea5098c-47d5-4b11-8e00-b6e722180ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37596afa0d354755a6d2fb82281f9689'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:17.689723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 973/1930] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:17 2022] DELETE /identity/v3/users/37596afa0d354755a6d2fb82281f9689 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:18.162876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.162876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.179598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560fec-a064-4a66-b804-206f89359c6a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.240885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.241755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.242032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.242310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] PATH_INFO: `/v3/projects/d6916620fd144ecc8a6de7280043aa0f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.243527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6916620fd144ecc8a6de7280043aa0f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.245486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:18.373025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:18.390596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6916620fd144ecc8a6de7280043aa0f', 'request_id': 'req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:18.400064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6916620fd144ecc8a6de7280043aa0f', 'request_id': 'req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:18.405836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6916620fd144ecc8a6de7280043aa0f', 'request_id': 'req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:18.470343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c601-1b33-41c4-8f23-bc4a1792ecd6 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.470840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c601-1b33-41c4-8f23-bc4a1792ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.470918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33c601-1b33-41c4-8f23-bc4a1792ecd6 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.472515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 974/1931] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:37:18.486813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c989e4-4ceb-465a-a3e2-22d847ce642b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.492112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c989e4-4ceb-465a-a3e2-22d847ce642b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.492112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c989e4-4ceb-465a-a3e2-22d847ce642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.501694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] The token cache is being invalidate because project d6916620fd144ecc8a6de7280043aa0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:18.501996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:18.502877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2d909b9d-26e6-48bd-829b-ea4a51bdd2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:18.504692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 958/1932] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:18 2022] DELETE /identity/v3/projects/d6916620fd144ecc8a6de7280043aa0f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:18.509652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737712-64be-4ee9-b17c-966f8814139a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.509968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737712-64be-4ee9-b17c-966f8814139a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.510131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737712-64be-4ee9-b17c-966f8814139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.534483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a2c989e4-4ceb-465a-a3e2-22d847ce642b None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:18.535442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-50737712-64be-4ee9-b17c-966f8814139a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:18.536217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a2c989e4-4ceb-465a-a3e2-22d847ce642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.537299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-50737712-64be-4ee9-b17c-966f8814139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.629853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 975/1933] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:18.643446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 959/1934] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:18.652251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.655672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.655672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.655889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737712-64be-4ee9-b17c-966f8814139a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.655889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-50737712-64be-4ee9-b17c-966f8814139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.672589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737712-64be-4ee9-b17c-966f8814139a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.678970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:18.684697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.685064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.685064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.685064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.685064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.697123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.697763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 976/1935] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:18.698867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:18.701583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.712445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc590f-407d-48c8-81c4-c01ad24ecd0c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.713237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 960/1936] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:18.717833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.718510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.718790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.719090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.719785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:18.720093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.722370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:18.735199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 977/1937] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:37:18.741641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.753535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927534b4-fb82-4837-bba0-864e71b946d0 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.759059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.759722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.760002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.760277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.761004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.762944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:18.826222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.827967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:18.842032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fbddb-586b-4123-91db-58a1a1c52c9b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.853289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.853289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.853289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.853289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] PATH_INFO: `/v3/users/f837783840e94cbc881fea70ac368d5b` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.853657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f837783840e94cbc881fea70ac368d5b)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.853657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:18.864241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:18.891456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 961/1938] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:18 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:18.895489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:18.960134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33196-56b0-45bf-9b29-3b32d7e61102 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:18.964902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:18.965568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:18.965855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:18.966129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:18.966815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:18.968765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.074355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f837783840e94cbc881fea70ac368d5b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.074924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f837783840e94cbc881fea70ac368d5b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.075553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f837783840e94cbc881fea70ac368d5b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.092443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f837783840e94cbc881fea70ac368d5b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.100245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69178e87-b6e5-4385-b61d-e8ea537885d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f837783840e94cbc881fea70ac368d5b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.103494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 962/1939] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:18 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:19.104638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.106395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.119715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bdfea-44c1-4b43-9c77-110debce6c62 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.124372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.125079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.129670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.129670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.129670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.129670 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.139063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 963/1940] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:19.143321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.153978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991123-3d64-45d6-8f6e-9bb10466d494 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.158666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.159586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.159586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.159866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.160624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.162452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.173702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 964/1941] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:19.178622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.188585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42aff-9002-489d-a613-15c469ef325d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.194303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.195243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.195525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.195822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] PATH_INFO: `/v3/projects/e64ee3b6abaa4f3d91ba9aeb856417e0/users/1f0e0b1c333d4cc48c702b45344603da/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.210720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ee3b6abaa4f3d91ba9aeb856417e0, user_id=1f0e0b1c333d4cc48c702b45344603da, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.213463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.245990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 978/1942] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:18 2022] DELETE /identity/v3/users/f837783840e94cbc881fea70ac368d5b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:19.250103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2893e-ed03-4728-9af5-ed174bee0922 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.250579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2893e-ed03-4728-9af5-ed174bee0922 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.251030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2893e-ed03-4728-9af5-ed174bee0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.273734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-5fb2893e-ed03-4728-9af5-ed174bee0922 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:19.275650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5fb2893e-ed03-4728-9af5-ed174bee0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.328210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 965/1943] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:19 2022] PUT /identity/v3/projects/e64ee3b6abaa4f3d91ba9aeb856417e0/users/1f0e0b1c333d4cc48c702b45344603da/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:19.329136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.330718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.339429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 979/1944] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:19.340754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.341043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.341321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.368985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] MFA Rules not processed for user `1f0e0b1c333d4cc48c702b45344603da`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:19.370204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.401944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743c1c-6707-48db-9f6d-3c1ab312c45a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.412626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.413538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.414320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.414695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] PATH_INFO: `/v3/users/96cf57e7d6e04151af4382ccd0afa22e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.415971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cf57e7d6e04151af4382ccd0afa22e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.418191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.459101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 980/1945] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:19.460161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.461474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.519013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7e991-c31a-4492-b456-c6089586b959 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.525257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.525257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.525257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.525257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.540370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.540922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.553000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 981/1946] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:19.553840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:19.555139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:19.569905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857d29-2dd9-4eef-91d7-0f2a3bb30605 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:19.575135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:19.576295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:19.576412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:19.576672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] PATH_INFO: `/v3/users/9e9c61eaf12b4a539986a2e8b96e7e21` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:19.577896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9c61eaf12b4a539986a2e8b96e7e21)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:19.585040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:19.747470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:19.883064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cf57e7d6e04151af4382ccd0afa22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.883409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9c61eaf12b4a539986a2e8b96e7e21'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.884035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9c61eaf12b4a539986a2e8b96e7e21'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.884780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9c61eaf12b4a539986a2e8b96e7e21'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.884953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cf57e7d6e04151af4382ccd0afa22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.885979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cf57e7d6e04151af4382ccd0afa22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.906560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cf57e7d6e04151af4382ccd0afa22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.913653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9c61eaf12b4a539986a2e8b96e7e21'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.919799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cf57e7d6e04151af4382ccd0afa22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:19.923408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1a97c74f-3ef8-4ab5-834a-d3d6f555a654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9c61eaf12b4a539986a2e8b96e7e21'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.041770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 966/1947] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:19 2022] DELETE /identity/v3/users/96cf57e7d6e04151af4382ccd0afa22e => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:20.042671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.044028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.109309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ae43-0e6c-48bb-81bd-bdc080690596 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.113768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.114504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.114504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.115076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.115712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.117839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.163754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 982/1948] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:19 2022] DELETE /identity/v3/users/9e9c61eaf12b4a539986a2e8b96e7e21 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:20.163754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.163754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.163754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.183779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:20.185028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.259531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 983/1949] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:20.261412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.263672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.274507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 967/1950] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:20 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:20.276531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.277844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.285161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45ea69-1c0f-495e-9a47-5ebb98eb064a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.349905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.350137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80150-c148-48ef-b084-f9d60a5c9df6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.350311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.350597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.350876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] PATH_INFO: `/v3/projects/bdd13eb647d34162baf0f066acdf4b29` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.352097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd13eb647d34162baf0f066acdf4b29)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.354063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.354817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.355691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.355973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.356562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] PATH_INFO: `/v3/users/fd2a9fbd67524399945fe3e698def518` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.357484 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2a9fbd67524399945fe3e698def518)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.359752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.583399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd13eb647d34162baf0f066acdf4b29', 'request_id': 'req-be212278-aeab-43f7-b192-cf73be6f0bad'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.583934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2a9fbd67524399945fe3e698def518'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.584349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2a9fbd67524399945fe3e698def518'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.584994 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2a9fbd67524399945fe3e698def518'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.589425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd13eb647d34162baf0f066acdf4b29', 'request_id': 'req-be212278-aeab-43f7-b192-cf73be6f0bad'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.597053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2a9fbd67524399945fe3e698def518'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.603931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2a9fbd67524399945fe3e698def518'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.672273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd13eb647d34162baf0f066acdf4b29', 'request_id': 'req-be212278-aeab-43f7-b192-cf73be6f0bad'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.683833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] The token cache is being invalidate because project bdd13eb647d34162baf0f066acdf4b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:20.684123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.684789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:20.686322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 984/1951] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:20 2022] DELETE /identity/v3/projects/bdd13eb647d34162baf0f066acdf4b29 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:20.687087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.688444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.744784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212278-aeab-43f7-b192-cf73be6f0bad admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.750338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 968/1952] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:20 2022] DELETE /identity/v3/users/fd2a9fbd67524399945fe3e698def518 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:20.750338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.752321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.753341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.754241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.754326 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.754588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.761915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.828782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140bebe-3b2f-455e-8148-aa66b4383ac4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.832443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.834153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.834391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.834845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.835126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.835394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.836075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.838045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.843670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:20.846072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 985/1953] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:20.846820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.851290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.861028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2585f-4e65-4eac-8ad0-db3a93a85392 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.865933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.866795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.867074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.867345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] PATH_INFO: `/v3/projects/139f68e6708447249f1e97dd27f613fe` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.868607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139f68e6708447249f1e97dd27f613fe)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.870522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:20.970448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 969/1954] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:20 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:20.971289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:20.972917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:20.985118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37c8bf-7c20-4ae8-be38-8c2b6825838f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:20.989774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:20.990628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:20.990908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:20.991182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] PATH_INFO: `/v3/users/ff0d184e170f46b88b069402e90eb714` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:20.992370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0d184e170f46b88b069402e90eb714)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:20.994332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.034052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139f68e6708447249f1e97dd27f613fe', 'request_id': 'req-cd8a283b-2338-44dc-93ce-eb79cf7441f6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.040608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139f68e6708447249f1e97dd27f613fe', 'request_id': 'req-cd8a283b-2338-44dc-93ce-eb79cf7441f6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.191933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139f68e6708447249f1e97dd27f613fe', 'request_id': 'req-cd8a283b-2338-44dc-93ce-eb79cf7441f6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.203624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] The token cache is being invalidate because project 139f68e6708447249f1e97dd27f613fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:21.203916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.204629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cd8a283b-2338-44dc-93ce-eb79cf7441f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.206205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 986/1955] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:20 2022] DELETE /identity/v3/projects/139f68e6708447249f1e97dd27f613fe => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:21.207530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.207884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.209118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.228508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:21.229788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.288364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 987/1956] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:21.289362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.290617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.302853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531730-7e91-4e65-ad22-b34f17decfc6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.307609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.308267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.308586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.308865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.309623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.311316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.322413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 988/1957] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:21.323544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.326099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.326618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0d184e170f46b88b069402e90eb714'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.327263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0d184e170f46b88b069402e90eb714'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.327898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0d184e170f46b88b069402e90eb714'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.338588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23eed-89f9-4ebd-8a63-1fc4d48ce03a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.340097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0d184e170f46b88b069402e90eb714'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.343398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.344255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.344565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.344843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] PATH_INFO: `/v3/users/28b12234cbe34087b0cdcde421b57aae` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.346033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b12234cbe34087b0cdcde421b57aae)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.346853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0d184e170f46b88b069402e90eb714'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.347941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.494339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 970/1958] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:20 2022] DELETE /identity/v3/users/ff0d184e170f46b88b069402e90eb714 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:21.495187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.496561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.554870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ccf03-f453-4135-a8c3-3f46b22d03e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.558605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.559427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.559708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.559989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.561864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.624228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.625712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.635732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 971/1959] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:21.637400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.638695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.650967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad36ab0-83f5-473b-a16c-945947fd4707 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.656161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.656861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.657144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.657419 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.658146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.659735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.670681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 972/1960] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:21.671830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.674030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.688969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f684-d3ec-47e0-afce-f1fd7506710b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.694045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.694960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.695245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.695520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] PATH_INFO: `/v3/projects/50104f93fc114b3789c9c36b2a879537` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.696744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] RBAC: Authorizing `identity:delete_project(project_id=50104f93fc114b3789c9c36b2a879537)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.698822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:21.722670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b12234cbe34087b0cdcde421b57aae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.724281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b12234cbe34087b0cdcde421b57aae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.725671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b12234cbe34087b0cdcde421b57aae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.738772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b12234cbe34087b0cdcde421b57aae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.746429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b12234cbe34087b0cdcde421b57aae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.854838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 989/1961] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:21 2022] DELETE /identity/v3/users/28b12234cbe34087b0cdcde421b57aae => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:21.856318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:21.859264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:21.875126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50104f93fc114b3789c9c36b2a879537', 'request_id': 'req-8e87144b-d21d-4d32-abbd-101fbb10daad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.882120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50104f93fc114b3789c9c36b2a879537', 'request_id': 'req-8e87144b-d21d-4d32-abbd-101fbb10daad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.891474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50104f93fc114b3789c9c36b2a879537', 'request_id': 'req-8e87144b-d21d-4d32-abbd-101fbb10daad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:21.961525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901f3bf-018d-470d-9a1e-f702ae62b7e4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:21.966454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:21.967359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:21.967636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:21.967961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] PATH_INFO: `/v3/projects/6be02e69e987419d80f025e392c73d32/users/1ccd5774038c4d98b16c9068f62bb233/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:21.983927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be02e69e987419d80f025e392c73d32, user_id=1ccd5774038c4d98b16c9068f62bb233, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:21.986691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8f7f3-8836-4cb7-8e27-ddee9f0f70b0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.004042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] The token cache is being invalidate because project 50104f93fc114b3789c9c36b2a879537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:22.004333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.005272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.009908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 973/1962] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:21 2022] DELETE /identity/v3/projects/50104f93fc114b3789c9c36b2a879537 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:22.010846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.012299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.024317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:22.080716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87144b-d21d-4d32-abbd-101fbb10daad admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.089407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 990/1963] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:21 2022] PUT /identity/v3/projects/6be02e69e987419d80f025e392c73d32/users/1ccd5774038c4d98b16c9068f62bb233/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:22.100771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.101148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.101502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.138362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] MFA Rules not processed for user `1ccd5774038c4d98b16c9068f62bb233`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:22.139761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.150174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.151256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.151562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.151839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] PATH_INFO: `/v3/users/b180fdc20dd64d6483f016fb882949cb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.153318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b180fdc20dd64d6483f016fb882949cb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:22.156248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.221738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 991/1964] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:22.222481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.224438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.245688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f352f3-8048-44a1-adc7-a5b274010bed None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.266709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.266709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.266709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.266709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] PATH_INFO: `/v3/projects/5ee8d236e9d648f68af463417190b262` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.267413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee8d236e9d648f68af463417190b262)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:22.267413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.418773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee8d236e9d648f68af463417190b262', 'request_id': 'req-dafd79cc-4e67-4df6-8dcf-ca4179c81163'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.419060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b180fdc20dd64d6483f016fb882949cb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.419735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b180fdc20dd64d6483f016fb882949cb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.420358 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b180fdc20dd64d6483f016fb882949cb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.425244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee8d236e9d648f68af463417190b262', 'request_id': 'req-dafd79cc-4e67-4df6-8dcf-ca4179c81163'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.433027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b180fdc20dd64d6483f016fb882949cb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.439781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b180fdc20dd64d6483f016fb882949cb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.547159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee8d236e9d648f68af463417190b262', 'request_id': 'req-dafd79cc-4e67-4df6-8dcf-ca4179c81163'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.558870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] The token cache is being invalidate because project 5ee8d236e9d648f68af463417190b262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:22.559159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.559834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.561445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 992/1965] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:22 2022] DELETE /identity/v3/projects/5ee8d236e9d648f68af463417190b262 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:22.562239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.563740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.627858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd79cc-4e67-4df6-8dcf-ca4179c81163 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.633537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.634458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.634736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.635008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] PATH_INFO: `/v3/projects/f3dcb2b032ea4e239280dffbfce4e6e1` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.636246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3dcb2b032ea4e239280dffbfce4e6e1)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:22.638196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.655476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 974/1966] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:22 2022] DELETE /identity/v3/users/b180fdc20dd64d6483f016fb882949cb => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:22.656711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.658553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.724872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90030082-75ee-4f68-8b7b-8ef5ebd3ceff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.730046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.730837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.731121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.731429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.732183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:22.734425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.792991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3dcb2b032ea4e239280dffbfce4e6e1', 'request_id': 'req-62d863e6-7852-4e89-b45d-846baa6564fc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.799021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3dcb2b032ea4e239280dffbfce4e6e1', 'request_id': 'req-62d863e6-7852-4e89-b45d-846baa6564fc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.871967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 975/1967] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:22 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:22.871967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.871967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.902069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3dcb2b032ea4e239280dffbfce4e6e1', 'request_id': 'req-62d863e6-7852-4e89-b45d-846baa6564fc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.923742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] The token cache is being invalidate because project f3dcb2b032ea4e239280dffbfce4e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:22.924747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.926986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-62d863e6-7852-4e89-b45d-846baa6564fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:22.929160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 993/1968] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:22 2022] DELETE /identity/v3/projects/f3dcb2b032ea4e239280dffbfce4e6e1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:22.931841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.933017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.933480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.947389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eff71b-4869-43f8-ba7a-d8beb6e057bd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.955626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:22.956928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.962289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.963500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.963829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.964142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] PATH_INFO: `/v3/projects/5ede5c15586d45f1bc5896cbc9f38821` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.965541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ede5c15586d45f1bc5896cbc9f38821)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:22.966898 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 994/1969] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:22.967482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:22.968012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:22.976904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:22.990127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef2f-6dda-4240-96f2-cf6d04132e69 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:22.997020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:22.997716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:22.998136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:22.998294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:22.998994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.000969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.110338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 995/1970] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:22 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:23.110338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:23.110635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.120013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ede5c15586d45f1bc5896cbc9f38821', 'request_id': 'req-fdc2d487-bcb3-44af-8b11-fac520ca76cf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.122710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dc2ec-7d2f-4a5b-b44c-47fa4d10719e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:23.126184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ede5c15586d45f1bc5896cbc9f38821', 'request_id': 'req-fdc2d487-bcb3-44af-8b11-fac520ca76cf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.131668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ede5c15586d45f1bc5896cbc9f38821', 'request_id': 'req-fdc2d487-bcb3-44af-8b11-fac520ca76cf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.181989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:23.182877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.183158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.183432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] PATH_INFO: `/v3/users/7feaf129c10747b8a8780404527f3893` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.184655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feaf129c10747b8a8780404527f3893)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.186580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.247619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] The token cache is being invalidate because project 5ede5c15586d45f1bc5896cbc9f38821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:23.247908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.248585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fdc2d487-bcb3-44af-8b11-fac520ca76cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.250170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 976/1971] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:22 2022] DELETE /identity/v3/projects/5ede5c15586d45f1bc5896cbc9f38821 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:23.251522 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.251882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.252250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.273084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:23.274281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.283754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 977/1972] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:23.283754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:23.289763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.296315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de12fb-7fd3-4f98-b302-39c1ae8d365e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:23.301051 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:23.301746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.302140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.302417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.303152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.304783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.314664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 978/1973] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:23.315456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:23.317075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.329639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6302aa-a8da-4593-aedb-a551293bf391 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:23.334882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:23.335699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.335980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.336257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] PATH_INFO: `/v3/projects/8e2fdc011efe4a7187714dd53d098b9e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.337445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2fdc011efe4a7187714dd53d098b9e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.339346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.582230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feaf129c10747b8a8780404527f3893'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.583142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feaf129c10747b8a8780404527f3893'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.583844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feaf129c10747b8a8780404527f3893'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.584950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2fdc011efe4a7187714dd53d098b9e', 'request_id': 'req-1136f21e-cecb-4c6e-af89-aeb56cd80e17'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.591672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2fdc011efe4a7187714dd53d098b9e', 'request_id': 'req-1136f21e-cecb-4c6e-af89-aeb56cd80e17'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.596292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feaf129c10747b8a8780404527f3893'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.597226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2fdc011efe4a7187714dd53d098b9e', 'request_id': 'req-1136f21e-cecb-4c6e-af89-aeb56cd80e17'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.603217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feaf129c10747b8a8780404527f3893'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.764089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] The token cache is being invalidate because project 8e2fdc011efe4a7187714dd53d098b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:23.764280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.765008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1136f21e-cecb-4c6e-af89-aeb56cd80e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:23.766681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 979/1974] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:23 2022] DELETE /identity/v3/projects/8e2fdc011efe4a7187714dd53d098b9e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:23.767984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.768280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.768599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.786537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:23.787790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.788195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:23.827185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 996/1975] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:23 2022] DELETE /identity/v3/users/7feaf129c10747b8a8780404527f3893 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:23.829124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:23.830819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.856113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 980/1976] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:23.864808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:23.864808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.871740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0b68-4d30-466e-a441-e48b164fc520 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:23.917510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364f5-6e66-4a1f-8755-7a1131a3f1fd admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:23.922257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:23.922934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.923217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.923495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.924682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:23.924682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.926351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1597-0dfc-471b-8d12-e1ac8ab5cdd8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.937509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:23.938574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.938957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.939739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] PATH_INFO: `/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6/users/275d84f6df6c458fbf26f358c3e02dee/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.944382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 997/1977] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:23.944382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b065d-015a-4bf7-a998-aa4b61c84d4c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.944382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b065d-015a-4bf7-a998-aa4b61c84d4c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.944382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b065d-015a-4bf7-a998-aa4b61c84d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.955452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=104f4a5d9d9840a3b9396751d4e6acc6, user_id=275d84f6df6c458fbf26f358c3e02dee, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:23.958243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010eb0-d565-4394-855a-d6f8e412efaf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:23.962853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e39b065d-015a-4bf7-a998-aa4b61c84d4c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:23.964620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e39b065d-015a-4bf7-a998-aa4b61c84d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:23.971995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 998/1978] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:23.973258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:23.974145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:23.974990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:23.994019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:23.996386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:24.003125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 999/1979] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:24.003878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.006281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:24.018006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538a2c-261d-4173-9e6e-a6097257d3c7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.023537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.024420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.024843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.025186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.025966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.027946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.046212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 981/1980] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:23 2022] PUT /identity/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6/users/275d84f6df6c458fbf26f358c3e02dee/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:24.047536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.047888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.048155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.068946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:24.070321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:24.135187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1000/1981] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:24.135187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.154971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 982/1982] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:24.155961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.170414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d188a2-265c-4438-9a7a-0004c3f074c5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.212991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d879642-e5e3-4c69-a908-1baed909bc23 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.219286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.219973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.220256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.220567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.221305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:24.221612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.223222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.235711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1001/1983] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:24.236521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.237456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.238212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.238499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.238780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.240234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.241854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.249389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c25e-2a23-42bf-b2be-fd843a27d0d7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.251876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 983/1984] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:24.252713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.255928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.256817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.259910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.259910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.259910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.261884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.262465 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d667-c6af-42d8-ada2-ac1c098885d2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.267242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.267841 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.268124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.268401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.269159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:24.269467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.271905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.284096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 984/1985] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:24.285003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.295710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d2c04-6631-4c8a-96d3-f3fe76116137 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.315161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.315161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.315161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.315161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.315546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.315546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.454584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1002/1986] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:24.455601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.465892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f6897-9af9-4545-ae20-a6efb0c759c1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.470616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.471477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.471755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.472028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] PATH_INFO: `/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6/users/275d84f6df6c458fbf26f358c3e02dee/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.474700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104f4a5d9d9840a3b9396751d4e6acc6, user_id=275d84f6df6c458fbf26f358c3e02dee, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.477393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.487823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1003/1987] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:24 2022] PUT /identity/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6/users/275d84f6df6c458fbf26f358c3e02dee/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:24.488755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.529250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 985/1988] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/projects => generated 361 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:24.529250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.529250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:24.555589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1b38-3c39-49f5-86a9-e39c3def1483 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.585652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:24.609894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ee0b-7530-4e91-9bb7-ba95dde8dd61 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.614880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.615757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.616036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.616629 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] PATH_INFO: `/v3/projects/fd83c4769e994b5eb456903b7e82cba0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.618070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd83c4769e994b5eb456903b7e82cba0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.618943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.619624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.620573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.621799 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.622759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.623348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.625291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.731834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1004/1989] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:24.732911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.778894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd83c4769e994b5eb456903b7e82cba0', 'request_id': 'req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:24.786178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd83c4769e994b5eb456903b7e82cba0', 'request_id': 'req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:24.792172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd83c4769e994b5eb456903b7e82cba0', 'request_id': 'req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:24.801249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7d09-fcde-4fe0-bc44-94a24d86550c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.876371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.877197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.877527 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.877751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.878481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.880744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.886109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] The token cache is being invalidate because project fd83c4769e994b5eb456903b7e82cba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d70985c-1dbd-45b1-8ed8-a8b539d9b3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 986/1990] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:24 2022] DELETE /identity/v3/projects/fd83c4769e994b5eb456903b7e82cba0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.895202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1005/1991] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:24.898253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:24.899563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:24.913441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c1b5-206c-49c2-b78d-020883ab68ba admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:24.920584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:24.921265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:24.921538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:24.922042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:24.922499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:24.924452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15604-3a8b-453b-b27d-0b02956bd13a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:24.925407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] MFA Rules not processed for user `275d84f6df6c458fbf26f358c3e02dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:24.926861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.009032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 987/1992] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:25.009719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.011134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.024725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42bed7-111d-4a6d-a383-9ad02ef8a41a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.029657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.030314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.030590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.032344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.032344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.033448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.076139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1006/1993] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:24 2022] POST /identity/v3/users => generated 281 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:25.076139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.076139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.076139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.081363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:25.082544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.090722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1007/1994] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:25.091474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.092767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.104335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd67ded-eea3-4fe1-b7d0-ecdde988140f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.109220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.109857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.110134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.114942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.114942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.114942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.123025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1008/1995] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:25.123788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.125367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.194478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 988/1996] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:25.196119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.200124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0e49-f5c1-41a7-a871-2cbe00daa69e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.204077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.204777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.205063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.205341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.210758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65f9d-67ee-4fd8-8200-60ebf4a2a52f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.215974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.216280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.216973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.217253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.217452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840ff32-0558-4144-a0b0-8ed16c4df09d service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.217588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.218235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.219837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.227658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1009/1997] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:25.229009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.229294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.229568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.231193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 989/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:25.231193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.241349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04326-93c2-4626-bb23-e5f56a5c09b4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.246764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.247977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.248270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.248518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:25.248643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] PATH_INFO: `/v3/projects/0fd77a7bd9bb41e6acc42bbd657de0f1/users/12fbe50c0d0c4b93b2e54856c8f296fe/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.249780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.258842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1010/1999] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:25.259471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.264682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd77a7bd9bb41e6acc42bbd657de0f1, user_id=12fbe50c0d0c4b93b2e54856c8f296fe, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.267516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.268776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055f2b-2314-412b-9f1e-0a7a83ea8875 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.273714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.274369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.274653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.274931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.275652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.277372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.288373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1011/2000] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:25.290608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.298351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccf67a-835e-49b0-86d4-891e3275da8c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.303859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.304478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.304787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.305055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.305752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.307278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.316881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1012/2001] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:25.318780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.334662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1529-047f-4b0f-b0e3-e80b3bff3b89 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.339460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.340123 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.340407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.340724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.341453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:25.341759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.343352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.345835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 990/2002] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:25 2022] PUT /identity/v3/projects/0fd77a7bd9bb41e6acc42bbd657de0f1/users/12fbe50c0d0c4b93b2e54856c8f296fe/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:25.347653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.362761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1013/2003] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:25.363747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.374500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71429f-b543-4fc3-a845-04cbf28657b6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.411045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df238f4d-8f59-4380-b2ee-34688672659b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.416495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.417178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.417459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.417735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.418462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.420067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.430263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 991/2004] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:25.434204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.434852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.435844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.436008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.436118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.436384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] PATH_INFO: `/v3/projects/8dce8cab89b14349ab81fb1bb7dbc712/users/8ab96a556eca4dad9d241fb7a412d78e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.452275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dce8cab89b14349ab81fb1bb7dbc712, user_id=8ab96a556eca4dad9d241fb7a412d78e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.454992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.500261 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46621f24-c18b-4a87-a8c9-587e86d7587e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.503917 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.504590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.504910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.505729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.507536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.565265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.566738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e0d64-42e1-4ebd-a95f-38a52317054b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.575890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 992/2006] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:25.577385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.577904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.579641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.587100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1014/2006] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:25 2022] PUT /identity/v3/projects/8dce8cab89b14349ab81fb1bb7dbc712/users/8ab96a556eca4dad9d241fb7a412d78e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:25.587100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.607436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] MFA Rules not processed for user `12fbe50c0d0c4b93b2e54856c8f296fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:25.608577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.646318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:25.651353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d015b-d6c9-4b81-8317-00119d76ef16 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.656150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.656886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.657190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.657455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.658148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.660063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eee3a-4289-491b-96a8-a4dfb465850a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.674015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 993/2007] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:25.674982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.685089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56634425-5d4f-4d37-aa90-664bea6b6541 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.690129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.690623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.690906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.691186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] PATH_INFO: `/v3/projects/c5716fda33c54f94b5793197f23b0e7a/users/b42db7b1a76c4a9e9a5a886d1f5741f7/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.705754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5716fda33c54f94b5793197f23b0e7a, user_id=b42db7b1a76c4a9e9a5a886d1f5741f7, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.709144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.766526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1015/2008] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:25.767647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.770443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.770443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.797077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] MFA Rules not processed for user `8ab96a556eca4dad9d241fb7a412d78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:25.798277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:25.816103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 994/2009] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:25 2022] PUT /identity/v3/projects/c5716fda33c54f94b5793197f23b0e7a/users/b42db7b1a76c4a9e9a5a886d1f5741f7/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:25.817215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.867282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1016/2010] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:25.868352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:25.893973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447520b-e205-4a0c-929a-2c54cccea39c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.899847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.899847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.899847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.899847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.900556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.902478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17170dce-8153-4c6e-9525-364428277c84 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:25.951013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078d10a-eac2-482e-b681-34efba39e06c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:25.955737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:25.956419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:25.956815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:25.957096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:25.957794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:25.960380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.110281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 995/2011] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:26.111897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.112449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.112889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.151074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1017/2012] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:25 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:26.152230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.153615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] MFA Rules not processed for user `b42db7b1a76c4a9e9a5a886d1f5741f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:26.154847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:26.228963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 996/2013] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:26.229710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.230667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb786-913f-4753-b124-cfa08c51ccac admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.259519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:26.283486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.284154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.284432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.284740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.298512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e392b7-2ab7-4857-b625-13b9905cd6c8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.303579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.304262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.304701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.304981 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.305678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.307652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.344410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.345880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.355253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1018/2014] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:26.356090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.369141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a8ff4-3ada-4569-ab53-1b99061640d6 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.374008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.374681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.374969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.375317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.376049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.377730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.398078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1019/2015] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:26.398276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 997/2016] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:26 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:26.398379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.398457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.400862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d7616-7dec-4c2a-bc2b-09495256801a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.401159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab0c3-fe33-4ba9-a276-9aa3f8597e8a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.404902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.405542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.405709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.405830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.406096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.406610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.407008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.407280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] PATH_INFO: `/v3/users/8ab96a556eca4dad9d241fb7a412d78e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.408548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab96a556eca4dad9d241fb7a412d78e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.410509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.415172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.416668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.425705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1020/2017] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:26.427826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.437151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf0a0-af85-4ee7-be21-bb0463aa563f service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.442248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.443549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.443840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.444117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.444875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.446542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.456815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1021/2018] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:26.457388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.469450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964d72-32ff-403d-9819-e090f556706e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.475922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.476690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.477045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.477331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.478068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.479900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.491581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1022/2019] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:26.492752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.504113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13719-277b-4857-8dec-7a79ea48a776 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.509200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.510094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.510373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.510645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] PATH_INFO: `/v3/projects/0131f62e76964834ba6cbbe5ee6f1892/users/17a7ce007f014bd7823b6d5933fc2188/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.528544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0131f62e76964834ba6cbbe5ee6f1892, user_id=17a7ce007f014bd7823b6d5933fc2188, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.531170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.617591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1023/2020] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:26 2022] PUT /identity/v3/projects/0131f62e76964834ba6cbbe5ee6f1892/users/17a7ce007f014bd7823b6d5933fc2188/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:26.618273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.685682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400827-d140-4ff0-8e05-aa7debaa675f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.690424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.691111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.691397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.691756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.692505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.697870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac11bfc-aa24-4d09-8503-4151cecf9242 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.699032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab96a556eca4dad9d241fb7a412d78e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:26.699691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab96a556eca4dad9d241fb7a412d78e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:26.700300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab96a556eca4dad9d241fb7a412d78e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:26.704689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1024/2021] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:26.705756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.706043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.706319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.715942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab96a556eca4dad9d241fb7a412d78e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:26.722937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab96a556eca4dad9d241fb7a412d78e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:26.732007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] MFA Rules not processed for user `17a7ce007f014bd7823b6d5933fc2188`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:26.733364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:26.799813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1025/2022] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:26.800775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.802845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:26.813643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 998/2023] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:26 2022] DELETE /identity/v3/users/8ab96a556eca4dad9d241fb7a412d78e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:26.815103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:26.817334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:26.817742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c4cfe-2e24-41ea-a7f8-b4e54036ae69 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.884593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.885525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.885804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.886077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] PATH_INFO: `/v3/projects/841cde2a4a16497795a77fa40ee713f5/users/d76b6f782c804a09b54b53ec2ad26e4f/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.886623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80454-bdb5-4eb9-bc16-074cd6844074 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:26.891185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:26.891873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.892183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.892456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:26.893177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.895147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dd466-de46-46b0-a684-a993afb8632c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.901157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=841cde2a4a16497795a77fa40ee713f5, user_id=d76b6f782c804a09b54b53ec2ad26e4f, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:26.903845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4844cb0-94d2-44bb-9825-1eefb06b9f3e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:26.987650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1026/2024] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:26 2022] PUT /identity/v3/projects/841cde2a4a16497795a77fa40ee713f5/users/d76b6f782c804a09b54b53ec2ad26e4f/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:26.989155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:26.989443 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:26.990262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.007870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:27.009113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.042499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 999/2025] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:26 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:27.042499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.042499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.042499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.069407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1027/2026] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:27.070292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.070729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] MFA Rules not processed for user `d76b6f782c804a09b54b53ec2ad26e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:27.071926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.080892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea3c2-b69c-4b5a-bc28-7e5964a0bb77 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.131278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:27.137679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1000/2027] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:27.138527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.141837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.142047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.142833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.143285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.143698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.144790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.147972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.206017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c8cb-a87a-45ca-8cd5-dbc0abd25e07 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.210375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.211042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.211781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.212074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.222119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.223524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.236183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1001/2028] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:27.237259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.249048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2b62-9908-443d-970d-934c41aea5b1 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.253372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.254148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.254502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.254853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.255701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.257818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.289507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1028/2029] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:27 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:27.303261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.325000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260bafb-52e2-44d9-bbc7-32ef2cf64ef3 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.328519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.329520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.330165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.330522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.331839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.335079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.350947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1029/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:27.355110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.369640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7418e2-04e3-42a9-bac5-0f2ae72295fa admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.374767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.376100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.376100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.376329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] PATH_INFO: `/v3/projects/ce364059ceaa4723ae1a69068a943564/users/b8f2b6d9b1454e648e87b3a5f96db398/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.391710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce364059ceaa4723ae1a69068a943564, user_id=b8f2b6d9b1454e648e87b3a5f96db398, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.394480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.417595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1002/2031] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:27 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:27.421885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.497032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dc7f2-3926-417a-b4a7-fbdf4f432d70 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.501803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.502479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.502767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.503043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.503741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.505950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.535216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1030/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:27 2022] PUT /identity/v3/projects/ce364059ceaa4723ae1a69068a943564/users/b8f2b6d9b1454e648e87b3a5f96db398/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:27.540614 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.568921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:27.623587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cd068-8b1c-4ea2-a06b-72211e9c9ee6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.628666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.629340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.629620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.629893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.631159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.632844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.643289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1031/2033] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:27.648068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.653993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1003/2034] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:27 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:27.655100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.658925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b02b1-f393-4704-bbb8-75d13298a08a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.666682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b563e8-18cc-481f-b1b1-cd27b23799ea admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.671934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.673113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.673646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.674019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] PATH_INFO: `/v3/projects/ce364059ceaa4723ae1a69068a943564/users/b8f2b6d9b1454e648e87b3a5f96db398/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.676687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce364059ceaa4723ae1a69068a943564, user_id=b8f2b6d9b1454e648e87b3a5f96db398, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.681856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc506ce-e715-40ff-b725-81ae99b4e061 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.690305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.691047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.691336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.691613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.692350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.695430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.696389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1032/2035] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:27 2022] PUT /identity/v3/projects/ce364059ceaa4723ae1a69068a943564/users/b8f2b6d9b1454e648e87b3a5f96db398/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:27.706775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.707140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.707431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.722975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1004/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:27.723889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.740631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] MFA Rules not processed for user `b8f2b6d9b1454e648e87b3a5f96db398`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:27.741866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.744711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2370-e30d-4f97-a87f-523d046cdec1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.817469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1033/2037] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:27.821791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.823634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.824307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.824307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] PATH_INFO: `/v3/projects/242c3f159c9c4532af435cae3513376a/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.830536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.832140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.841310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=242c3f159c9c4532af435cae3513376a, user_id=5d5e5a2eaf444e18a0c2f9c43cbfdb52, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.849772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.915410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184715bb-b3c7-4392-87d1-0bb4290f4fb6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.920075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.920832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.921184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.921465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.932788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.934255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.945053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1034/2038] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:27.945957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:27.947283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:27.961400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37975e08-0dd1-48e1-acf7-cec96c9984a4 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:27.968370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:27.969445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:27.969725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:27.969997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] PATH_INFO: `/v3/projects/8dce8cab89b14349ab81fb1bb7dbc712` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:27.971249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dce8cab89b14349ab81fb1bb7dbc712)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:27.972569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1005/2039] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:27 2022] PUT /identity/v3/projects/242c3f159c9c4532af435cae3513376a/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:27.973782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:27.977318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.047839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401125f-9c87-4a4b-af2d-7a288c2e3b8f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.052843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.053516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.053797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.054072 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.054802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.056401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.066041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1006/2040] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:28.070298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.080305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07ac3-faab-4b00-a111-fd4db9dfe80c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.088208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.089686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.089932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.090214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] PATH_INFO: `/v3/projects/242c3f159c9c4532af435cae3513376a/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.092332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242c3f159c9c4532af435cae3513376a, user_id=5d5e5a2eaf444e18a0c2f9c43cbfdb52, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.095585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.112181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1007/2041] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:28 2022] PUT /identity/v3/projects/242c3f159c9c4532af435cae3513376a/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:28.113082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.114583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:28.115084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.124821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dce8cab89b14349ab81fb1bb7dbc712', 'request_id': 'req-1d806692-05c3-417b-9354-2f48be7c809c'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:28.138490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dce8cab89b14349ab81fb1bb7dbc712', 'request_id': 'req-1d806692-05c3-417b-9354-2f48be7c809c'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:28.196514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ee40-25ba-4403-9bbc-17ea6ea2f855 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.200854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.201524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.201866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.202139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.238715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dce8cab89b14349ab81fb1bb7dbc712', 'request_id': 'req-1d806692-05c3-417b-9354-2f48be7c809c'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:28.252377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] The token cache is being invalidate because project 8dce8cab89b14349ab81fb1bb7dbc712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:28.252957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:28.253798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1d806692-05c3-417b-9354-2f48be7c809c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:28.255765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1035/2042] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:27 2022] DELETE /identity/v3/projects/8dce8cab89b14349ab81fb1bb7dbc712 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:28.261765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.261891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.262268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.288005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.289672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e6095-4d0c-4c0d-a888-7965f1d1b847 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.304689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1008/2043] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:28.309218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9a32-d33a-4bf8-b3b1-61f440ba3367 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.311846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9a32-d33a-4bf8-b3b1-61f440ba3367 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.311846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b9a32-d33a-4bf8-b3b1-61f440ba3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.313401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] MFA Rules not processed for user `5d5e5a2eaf444e18a0c2f9c43cbfdb52`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:28.315417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.349256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e21b9a32-d33a-4bf8-b3b1-61f440ba3367 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:28.351106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e21b9a32-d33a-4bf8-b3b1-61f440ba3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.433630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1009/2044] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:28.442227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.442521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.443299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.443490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1036/2045] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:28.463930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:28.466266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.474085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1010/2046] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:28.478924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.490504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4066077-2432-4e5f-b52c-3ee7df08eafd None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.495292 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.495965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.500331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.500331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.500331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:28.500331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.500331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.521042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1037/2047] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:28.525536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.536596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d9cd2-66de-4067-84bc-1ebe3bca8960 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.543991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.544817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.545102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.548432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.549193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.551220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.569390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:28.709694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1011/2048] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:28 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:28.713909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.723713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ca67-505a-4708-aadf-45e13005e791 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.778685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.779348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.779630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.779905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.780629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.782669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.804755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.806494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.864200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584d8f-f63f-404e-97cb-43c5ba8cf2b7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.868624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.869281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.869568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.869850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.871631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:28.893893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1038/2049] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:28 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:28.895345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.910385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aafc5-65fa-4154-b938-0cfcce3aa9b0 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.915279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.915980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.916469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.916948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.918004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.919646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.931062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1039/2050] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:28.934830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.936065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.937588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.945491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3728e4-769f-40ab-9680-7de63fdda4be admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.947449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1012/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:28.950284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.950940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.951253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.951837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:28.952331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:28.953869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422f63-b93f-4f4d-8447-bc58293e25a6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:28.967071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1040/2052] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:28.969044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:28.979706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500f06-6bab-4cd8-81f4-c334d70ca266 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:28.991311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:28.992403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:28.992738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:28.993012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] PATH_INFO: `/v3/projects/a4a8c7ef0d194a8f913b182b0fb52961/users/41cccabeec434f2cb45482138001a606/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.009231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a8c7ef0d194a8f913b182b0fb52961, user_id=41cccabeec434f2cb45482138001a606, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.011929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.095745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1013/2053] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:28 2022] PUT /identity/v3/projects/a4a8c7ef0d194a8f913b182b0fb52961/users/41cccabeec434f2cb45482138001a606/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:29.106834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.107125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.107406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.135937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] MFA Rules not processed for user `41cccabeec434f2cb45482138001a606`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:29.141078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:29.211822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1041/2054] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:29.216274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:29.245433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:29.289744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506670-8768-4f30-b016-38d2b0787bb3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:29.295106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:29.295773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.296088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.296388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.297131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.299077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.435055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1014/2055] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:29 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:29.438368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:29.449568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4011-a634-4dc3-9cef-3d45b9fff55f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:29.509247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:29.510060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.510352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.510632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.511364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.513389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.719179 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1042/2056] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:29 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:29.723919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:29.748343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de50a-3150-4e93-aab5-78d24f434196 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:29.763150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:29.763850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.764131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.764404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.765191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.766859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.793262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1015/2057] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:29.797383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:29.810556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430bff2-0652-41dd-aca6-9676a0230e87 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:29.816683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:29.817404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.817729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.820621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.820621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.820851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fd8d7-1e22-4388-8597-e6bb58ef401e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.832778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1043/2058] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:29.838128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:29.849290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0527-0337-4562-bfb7-488fd887ab78 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:29.861974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:29.862905 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.863192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.864003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] PATH_INFO: `/v3/projects/906a6fbea2504598a4f070c86b19582c/users/00d772e2b6274814b020568bcd618d73/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:29.883563 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=906a6fbea2504598a4f070c86b19582c, user_id=00d772e2b6274814b020568bcd618d73, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:29.887203 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:29.936875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:29.973551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1016/2059] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:29 2022] PUT /identity/v3/projects/906a6fbea2504598a4f070c86b19582c/users/00d772e2b6274814b020568bcd618d73/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:29.984169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:29.984457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:29.985020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.019011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] MFA Rules not processed for user `00d772e2b6274814b020568bcd618d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:30.020156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:30.091341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1044/2060] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:30.095728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.176769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a096f-44a2-414d-859a-fb36d4532ecb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.181848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.182815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.182815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.183089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.183760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.186052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.368306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1017/2061] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:30 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:30.369544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.382117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce305-f5c3-4505-94e1-c088f254e49c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.440434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.441143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.441452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.441729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.442463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.445099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.554545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1045/2062] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:30 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:30.555411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.566018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83641e7-2e35-445d-8586-e43b6de75bf5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.571282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.571954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.572239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.572545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.573280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.574920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.586100 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1018/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:30.595586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.606962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534b56-eba7-4335-92d3-e3bc9632aa5b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.613878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.615868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.616540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.616751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] PATH_INFO: `/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675/users/aca26a4969e640f89c4f68aba73a59e6/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.628924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:30.636450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f333e4d3eb4e2ea7b1983ca17ab675, user_id=aca26a4969e640f89c4f68aba73a59e6, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.639245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.754068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1046/2064] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:30 2022] PUT /identity/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675/users/aca26a4969e640f89c4f68aba73a59e6/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:30.760094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.771043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4936ae-886f-4f2c-9347-153762ee8ffb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.840335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.841080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.841319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.841595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.842363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.844101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8c8c-8e1e-434c-a39a-14e5b9156b85 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.861539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1019/2065] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:30.865107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:30.877348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836c7a5-1d1a-47bb-a394-edf88e950ada admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:30.889249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:30.890329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.890841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.891191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] PATH_INFO: `/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675/users/aca26a4969e640f89c4f68aba73a59e6/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.893512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f333e4d3eb4e2ea7b1983ca17ab675, user_id=aca26a4969e640f89c4f68aba73a59e6, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:30.896406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:30.910311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1047/2066] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:30 2022] PUT /identity/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675/users/aca26a4969e640f89c4f68aba73a59e6/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:30.938724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:30.939036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:30.939748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:30.969897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] MFA Rules not processed for user `aca26a4969e640f89c4f68aba73a59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:30.971095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:31.045265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1020/2067] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:31.363677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:31.365493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:31.422738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff481e9-3a14-4daf-8e1a-f101dbfc7ba4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:31.426444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:31.427126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:31.427405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:31.427781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:31.484102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:31.485903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:31.494899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1048/2068] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:31.924388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:32.589350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:32.595097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:32.606350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e3bd-d640-4495-b16e-1f547c549ee1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:32.610168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:32.611155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:32.611507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:32.611907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:32.616225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:32.617352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:32.618736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:32.677494 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:32.679165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:32.687819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46198ee1-608f-4108-8263-fb1a71b1b058 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:32.688675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1021/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:32.692797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:32.693792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:32.694405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:32.694405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] PATH_INFO: `/v3/users/1f0e0b1c333d4cc48c702b45344603da` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:32.695633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0e0b1c333d4cc48c702b45344603da)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:32.697593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:32.918106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:32.919530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:32.933318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a69d0-903b-4708-9764-dfbfc0f2bd57 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:32.937927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:32.938798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:32.939601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:32.939601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] PATH_INFO: `/v3/users/b42db7b1a76c4a9e9a5a886d1f5741f7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:32.944654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42db7b1a76c4a9e9a5a886d1f5741f7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:32.944766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0e0b1c333d4cc48c702b45344603da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:32.944766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0e0b1c333d4cc48c702b45344603da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:32.944766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0e0b1c333d4cc48c702b45344603da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:32.945004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:32.959150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0e0b1c333d4cc48c702b45344603da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:32.969817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-09cd037b-93ba-46c1-b7dc-c6bc793f30d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0e0b1c333d4cc48c702b45344603da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.074697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:33.137622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1049/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:32 2022] DELETE /identity/v3/users/1f0e0b1c333d4cc48c702b45344603da => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:33.142051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:33.142356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:33.142634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:33.160760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:33.161985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:33.203244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42db7b1a76c4a9e9a5a886d1f5741f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.203966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42db7b1a76c4a9e9a5a886d1f5741f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.205040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42db7b1a76c4a9e9a5a886d1f5741f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.220389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42db7b1a76c4a9e9a5a886d1f5741f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.230833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42db7b1a76c4a9e9a5a886d1f5741f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:33.234126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1050/2071] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:33.241084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:33.242740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:33.298348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206ab9-47c5-4c60-8e96-e06b129392ca None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:33.302207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:33.302853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:33.303848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:33.304131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:33.313299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:33.314771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c612-72c9-4f9a-94ee-d1c5b9244613 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:33.325211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1051/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:33.351006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1022/2073] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:32 2022] DELETE /identity/v3/users/b42db7b1a76c4a9e9a5a886d1f5741f7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:33.357033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:33.357504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:33.357943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:33.379844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:33.381152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:33.448929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1052/2074] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:33.458890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:33.520049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d78ff-abbb-42aa-9393-eab76545d4d3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:33.523939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:33.524657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:33.525402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:33.525402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:33.537059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:33.538617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:33.552829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1023/2075] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:33.804482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:33.806937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:33.837337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4106d1-f841-488e-a216-1d640dddcbec None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:33.851795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:33.851795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:33.851795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:33.851795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] PATH_INFO: `/v3/projects/e64ee3b6abaa4f3d91ba9aeb856417e0` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:33.852117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64ee3b6abaa4f3d91ba9aeb856417e0)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:33.852117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:34.008730 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:34.041657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64ee3b6abaa4f3d91ba9aeb856417e0', 'request_id': 'req-da4fc673-ef64-481a-9b7c-cccf0baf2658'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.052546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64ee3b6abaa4f3d91ba9aeb856417e0', 'request_id': 'req-da4fc673-ef64-481a-9b7c-cccf0baf2658'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.154746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64ee3b6abaa4f3d91ba9aeb856417e0', 'request_id': 'req-da4fc673-ef64-481a-9b7c-cccf0baf2658'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.166997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] The token cache is being invalidate because project e64ee3b6abaa4f3d91ba9aeb856417e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:34.167362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.167998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.169578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1053/2076] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:33 2022] DELETE /identity/v3/projects/e64ee3b6abaa4f3d91ba9aeb856417e0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:34.173608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:34.183781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88587-6033-4a1c-9a7b-ddb96eb78d76 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:34.248369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:34.249450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:34.249907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:34.250295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] PATH_INFO: `/v3/users/1ccd5774038c4d98b16c9068f62bb233` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:34.251747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccd5774038c4d98b16c9068f62bb233)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:34.253916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:34.266177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:34.278862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:34.306961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc673-ef64-481a-9b7c-cccf0baf2658 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:34.312977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:34.314327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:34.314789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:34.315242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] PATH_INFO: `/v3/projects/c5716fda33c54f94b5793197f23b0e7a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:34.316981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5716fda33c54f94b5793197f23b0e7a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:34.320103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:34.547595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccd5774038c4d98b16c9068f62bb233'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.548294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5716fda33c54f94b5793197f23b0e7a', 'request_id': 'req-323ecfc2-d1f8-404d-9160-c60bb8b290e4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.548758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccd5774038c4d98b16c9068f62bb233'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.549526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccd5774038c4d98b16c9068f62bb233'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.556241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5716fda33c54f94b5793197f23b0e7a', 'request_id': 'req-323ecfc2-d1f8-404d-9160-c60bb8b290e4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.563507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccd5774038c4d98b16c9068f62bb233'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.571256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-59824e71-078b-4d01-bbef-2ea58f7a4908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccd5774038c4d98b16c9068f62bb233'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.680469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5716fda33c54f94b5793197f23b0e7a', 'request_id': 'req-323ecfc2-d1f8-404d-9160-c60bb8b290e4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.691201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] The token cache is being invalidate because project c5716fda33c54f94b5793197f23b0e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:34.691489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.692147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:34.694998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1054/2077] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:34 2022] DELETE /identity/v3/projects/c5716fda33c54f94b5793197f23b0e7a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:34.695153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:34.696649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:34.754850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ecfc2-d1f8-404d-9160-c60bb8b290e4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:34.759182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:34.759833 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:34.760117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:34.760401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:34.762337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:34.814816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1024/2078] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:34 2022] DELETE /identity/v3/users/1ccd5774038c4d98b16c9068f62bb233 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:34.814816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:34.814816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:34.814816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:34.832182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:34.834228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c1cc7-32ec-4e05-923a-9942468d07d9 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:34.840525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:34.849213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:34.851040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1055/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:34.920546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1025/2080] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:34.930044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:34.931382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:34.931681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:34.969739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:34.973228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:34.985038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1056/2081] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:34.989268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.003058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be8a2-a098-477a-b73b-c18b760bfe9f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.006901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:35.012689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.019092 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.035249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1026/2082] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:35.040861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.054471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d966f-35d2-454e-83e1-d87efabcd44f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.059416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.060234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.060667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.061044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.061838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.063998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.200135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:35.212131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.216464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:35.250401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1057/2083] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:35 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:35.256128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.366519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9bf-73c9-4128-92d7-d42afea15bf1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.395899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079dc6-d5d8-46bf-becf-d46336e18997 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.403529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.404226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.404578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.406210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.407002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.409644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.442506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.443193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.443477 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.443756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.445850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:35.511059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.512567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.523378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1027/2084] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:35.545624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.547172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:35.551621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1058/2085] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:35 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:35.555653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.563550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6cba-fc8e-419b-924b-bd6c498c1b6b service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.569035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.570336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.570763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.571154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] PATH_INFO: `/v3/projects/6be02e69e987419d80f025e392c73d32` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.571412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bc252-2903-421f-816d-df45edb1136c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.572613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be02e69e987419d80f025e392c73d32)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.581489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.582608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.582608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.582608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.582608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.582948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.582948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.593378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1059/2086] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:35.596782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.610102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea9-97b3-4a8c-af4e-1be81e2659b6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.615398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.616227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.616687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.616972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.621371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.621371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.630754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1060/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:35.635134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:35.645497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ddd3b-75ea-401a-8ae3-32a2f01ac93f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:35.651177 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:35.652078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.652520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.652805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] PATH_INFO: `/v3/projects/874c669c1b1b40c49841ee9219d369a8/users/826cacdea2404aa4b8dde687fd522780/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.669881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] RBAC: Authorizing `identity:create_grant(project_id=874c669c1b1b40c49841ee9219d369a8, user_id=826cacdea2404aa4b8dde687fd522780, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:35.672830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b1dfc-e041-4f0b-b35e-72f50256193b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:35.847516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1061/2088] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:35 2022] PUT /identity/v3/projects/874c669c1b1b40c49841ee9219d369a8/users/826cacdea2404aa4b8dde687fd522780/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:35.855726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be02e69e987419d80f025e392c73d32', 'request_id': 'req-f24577b1-6214-4796-a8a5-7c9347147176'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:35.859062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:35.859558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:35.860157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:35.862620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be02e69e987419d80f025e392c73d32', 'request_id': 'req-f24577b1-6214-4796-a8a5-7c9347147176'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:35.868420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be02e69e987419d80f025e392c73d32', 'request_id': 'req-f24577b1-6214-4796-a8a5-7c9347147176'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:35.932592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] MFA Rules not processed for user `826cacdea2404aa4b8dde687fd522780`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:35.934241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.005161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] The token cache is being invalidate because project 6be02e69e987419d80f025e392c73d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:36.005388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.005894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.008272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1028/2089] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:35 2022] DELETE /identity/v3/projects/6be02e69e987419d80f025e392c73d32 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:36.008864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:36.010212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.027162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1062/2090] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:36.027874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:36.104295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb59e11-3e19-4782-adbf-ab02a23d7279 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:36.110951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:36.112112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:36.112553 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:36.112892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] PATH_INFO: `/v3/users/275d84f6df6c458fbf26f358c3e02dee` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:36.130503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24577b1-6214-4796-a8a5-7c9347147176 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:36.137764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:36.138350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:36.138831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:36.139398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275d84f6df6c458fbf26f358c3e02dee)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:36.139532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] PATH_INFO: `/v3/users/17a7ce007f014bd7823b6d5933fc2188` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:36.140942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a7ce007f014bd7823b6d5933fc2188)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:36.141385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:36.143181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:36.504842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a7ce007f014bd7823b6d5933fc2188'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.505638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a7ce007f014bd7823b6d5933fc2188'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.506278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a7ce007f014bd7823b6d5933fc2188'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.522123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a7ce007f014bd7823b6d5933fc2188'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.537730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a7ce007f014bd7823b6d5933fc2188'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.546899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275d84f6df6c458fbf26f358c3e02dee'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.547707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275d84f6df6c458fbf26f358c3e02dee'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.548403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275d84f6df6c458fbf26f358c3e02dee'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.564121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275d84f6df6c458fbf26f358c3e02dee'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.573516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-5959f050-0a9e-4b35-ab87-9d7051001697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275d84f6df6c458fbf26f358c3e02dee'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:36.630123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1029/2091] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:36 2022] DELETE /identity/v3/users/17a7ce007f014bd7823b6d5933fc2188 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:36.631125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:36.634193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.706200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca2b6-5cdb-42b8-980a-a537bb42cae3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:36.716238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:36.716238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:36.716238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:36.716532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:36.719471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.774035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:36.778997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1063/2092] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:36 2022] DELETE /identity/v3/users/275d84f6df6c458fbf26f358c3e02dee => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:36.780183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:36.780469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:36.780776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:36.787075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:36.790230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:36.799689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:36.801409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.805055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1030/2093] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:36.869402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1064/2094] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:36.885580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:36.886992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:36.951955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cab1ff-a1a3-41e8-ab37-f75afa6e6de3 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:37.039326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:37.040260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:37.040747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:37.041178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:37.054616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:37.057053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:37.082330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1031/2095] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:37.088597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:37.467563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:37.468931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:37.491650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2628a-bd79-4a6e-9d90-55ea194fc062 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:37.505519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:37.506159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:37.508353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:37.508353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] PATH_INFO: `/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:37.510021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=104f4a5d9d9840a3b9396751d4e6acc6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:37.514303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:37.689609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104f4a5d9d9840a3b9396751d4e6acc6', 'request_id': 'req-170f78e1-3a35-4752-8494-ad75b1c1ccdb'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:37.691650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104f4a5d9d9840a3b9396751d4e6acc6', 'request_id': 'req-170f78e1-3a35-4752-8494-ad75b1c1ccdb'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:37.735813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:37.738728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:37.800814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c716f57-1a66-4d1b-84c5-3aac706b0ec3 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:37.825168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104f4a5d9d9840a3b9396751d4e6acc6', 'request_id': 'req-170f78e1-3a35-4752-8494-ad75b1c1ccdb'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:37.843363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] The token cache is being invalidate because project 104f4a5d9d9840a3b9396751d4e6acc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:37.843864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:37.844660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:37.851925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1065/2096] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:37 2022] DELETE /identity/v3/projects/104f4a5d9d9840a3b9396751d4e6acc6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:37.853787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:37.855725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:37.890933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:37.894088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:37.895888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:37.896277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:37.904658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:37.991260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f78e1-3a35-4752-8494-ad75b1c1ccdb admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.003387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.005748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.006152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.008706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] PATH_INFO: `/v3/projects/0131f62e76964834ba6cbbe5ee6f1892` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.009869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0131f62e76964834ba6cbbe5ee6f1892)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.013290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.030395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.033511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d159ff-63b7-4207-ba54-a0417cb8e5c1 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.072237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1032/2097] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:38.074239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506677-0d53-4992-82ec-f1d99f96067a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.074527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506677-0d53-4992-82ec-f1d99f96067a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.074804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506677-0d53-4992-82ec-f1d99f96067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.110806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-73506677-0d53-4992-82ec-f1d99f96067a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:38.113158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73506677-0d53-4992-82ec-f1d99f96067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:38.134759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1033/2098] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:38.144632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.145138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.151421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.172082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:38.173462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:38.206826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1034/2099] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:38.208013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.219075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:38.225475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60f152-7d56-4ae8-9654-df79168dbb6e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.232187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.232965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.233562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.233902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.234701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:38.235054 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.247393 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.269098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1035/2100] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:37:38.273089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.279490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0131f62e76964834ba6cbbe5ee6f1892', 'request_id': 'req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.294686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0131f62e76964834ba6cbbe5ee6f1892', 'request_id': 'req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.295084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d92b-268f-4dc0-8426-927bfdfedfdf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.396875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:38.397249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.397662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0131f62e76964834ba6cbbe5ee6f1892', 'request_id': 'req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.398492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.398684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.399040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.400521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.402811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.415399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] The token cache is being invalidate because project 0131f62e76964834ba6cbbe5ee6f1892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:38.415719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.416399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.422534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1066/2101] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:37 2022] DELETE /identity/v3/projects/0131f62e76964834ba6cbbe5ee6f1892 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:38.423669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.429043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:38.465365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c49d7f-c71b-4ae3-bf54-2c0387dbbb18 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.471531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.480026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.480026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.480026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] PATH_INFO: `/v3/users/b8f2b6d9b1454e648e87b3a5f96db398` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.480026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f2b6d9b1454e648e87b3a5f96db398)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.480026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.573407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1036/2102] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:38 2022] POST /identity/v3/projects => generated 367 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:38.574367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.576447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:38.666957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268155-de61-4430-ac23-62afab08bd91 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.678447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.679942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.680284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.681157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.681520 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.686113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.762284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f2b6d9b1454e648e87b3a5f96db398'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.762956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f2b6d9b1454e648e87b3a5f96db398'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.763786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f2b6d9b1454e648e87b3a5f96db398'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.781347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f2b6d9b1454e648e87b3a5f96db398'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.789294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f25d8149-de2c-4ffe-97d2-d8dcf8c2f0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f2b6d9b1454e648e87b3a5f96db398'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:38.890642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1037/2103] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:38 2022] POST /identity/v3/users => generated 284 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:38.891273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.892930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:38.907429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c561-fb28-47c9-b9dc-f104f0a48dab admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.914306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:38.915250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.915532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.915807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.916565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:38.918214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:38.922389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1067/2104] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:38 2022] DELETE /identity/v3/users/b8f2b6d9b1454e648e87b3a5f96db398 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:38.922389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f47f-76fa-4aff-8b4d-161241ebeacd None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.922389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f47f-76fa-4aff-8b4d-161241ebeacd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.922389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f47f-76fa-4aff-8b4d-161241ebeacd None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.923681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1068/2105] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:37:38.931545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:38.932082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:38.932534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:38.936276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1038/2106] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:38.937499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:38.949624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce1c9-1348-42db-90f8-c11eb410e846 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:38.956724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] MFA Rules not processed for user `b199ab9b81fd4bfa8f2282e45971a269`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:38.958699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.021554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.022346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.022730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.023776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.024984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.026603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.032736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1069/2107] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:39.037896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1039/2108] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:39.042156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.047762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.049988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.059121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3e25-c512-47bc-9fa1-5bc9663d8c79 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.066862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc67bf-23f4-4e47-8339-363b8214edaa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.068331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.071490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.071998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.072516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] PATH_INFO: `/v3/projects/d8b7ee26408a493595365909e8ae27e0/users/96ea9ef3d422419ca84e4caf0f6e9d8d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.089950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.090612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.090897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.091171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.094666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b7ee26408a493595365909e8ae27e0, user_id=96ea9ef3d422419ca84e4caf0f6e9d8d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.097385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389934c-fbac-42e5-a75d-63b076b2767b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.099949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.102347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.121869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1040/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:39.123386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.124813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.140250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e78d40-fabf-44f3-a7ad-11e6f213bede service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.145784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.146655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.146935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.147260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] PATH_INFO: `/v3/users/a9cef287aa974448b3abef26a8018f03` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.149692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cef287aa974448b3abef26a8018f03)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.151614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.288012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1070/2110] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:39 2022] PUT /identity/v3/projects/d8b7ee26408a493595365909e8ae27e0/users/96ea9ef3d422419ca84e4caf0f6e9d8d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:39.299665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.299954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.300239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.328367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] MFA Rules not processed for user `96ea9ef3d422419ca84e4caf0f6e9d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:39.329717 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.384173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cef287aa974448b3abef26a8018f03'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.384766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cef287aa974448b3abef26a8018f03'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.385436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cef287aa974448b3abef26a8018f03'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.393731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1071/2111] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:39.398958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.401307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cef287aa974448b3abef26a8018f03'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.408881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cef287aa974448b3abef26a8018f03'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.464276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21e6b-4613-458c-bb9a-c70a6d6f2de7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.468958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.469660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.469940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.470215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.470907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.473139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.521338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1041/2112] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:39 2022] DELETE /identity/v3/users/a9cef287aa974448b3abef26a8018f03 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:39.522272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.524410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.593366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9927-3382-4bab-873f-afc88194f803 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.593749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1072/2113] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:39 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:39.598027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.600097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.658434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.659828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.660612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.660896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] PATH_INFO: `/v3/projects/ce364059ceaa4723ae1a69068a943564` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.662437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce364059ceaa4723ae1a69068a943564)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.666594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.698981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c363b-0fa0-4739-b777-16f8c769a8d9 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.704358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.705724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.706165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.706970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.712964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.712964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.813587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1073/2114] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:39 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:39.819599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.825208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:39.831865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce364059ceaa4723ae1a69068a943564', 'request_id': 'req-cd6f120e-a925-4eba-84a7-7f15e07d951c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.840382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce364059ceaa4723ae1a69068a943564', 'request_id': 'req-cd6f120e-a925-4eba-84a7-7f15e07d951c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.846846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce364059ceaa4723ae1a69068a943564', 'request_id': 'req-cd6f120e-a925-4eba-84a7-7f15e07d951c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.852079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c69-6dfe-4fa4-9a9c-f5f8d5d42f6a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:39.911478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:39.912406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:39.912742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:39.913080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] PATH_INFO: `/v3/projects/c8166c0f90124dac9d758720686535e9` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:39.914339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8166c0f90124dac9d758720686535e9)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:39.917291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:39.987529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] The token cache is being invalidate because project ce364059ceaa4723ae1a69068a943564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:39.988006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.991356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:39.991356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1042/2115] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:39 2022] DELETE /identity/v3/projects/ce364059ceaa4723ae1a69068a943564 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:39.991356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:39.992361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.004417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f120e-a925-4eba-84a7-7f15e07d951c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.009765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.010417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.010702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.010979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.011707 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.013353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5357e8-62e8-42b4-8615-1437b9ab24a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.024433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1043/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:40.025718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.026013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.026305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.044061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:40.045283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.053220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1044/2117] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:40.056849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.065213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b67d5-c3d9-4a4d-9673-890f5db5579f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.080196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8166c0f90124dac9d758720686535e9', 'request_id': 'req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:40.086923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8166c0f90124dac9d758720686535e9', 'request_id': 'req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:40.126303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.127207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.127488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.127760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] PATH_INFO: `/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a/users/d27f82af851a454fbcf513be1918fbdf/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.155063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e2f28055e74fb5bf3bfb5d0c53238a, user_id=d27f82af851a454fbcf513be1918fbdf, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.158320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5f7be-e551-4637-9f5f-a340f51ff1df admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.190605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:40.191331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8166c0f90124dac9d758720686535e9', 'request_id': 'req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:40.204631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] The token cache is being invalidate because project c8166c0f90124dac9d758720686535e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:40.204929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:40.205600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b7fb8b2f-d994-4e4d-b51d-3a4d750fe519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:40.207516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1074/2118] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:39 2022] DELETE /identity/v3/projects/c8166c0f90124dac9d758720686535e9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:40.208806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fb14-c0c0-4712-b2c0-3f0627fdc183 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.209096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fb14-c0c0-4712-b2c0-3f0627fdc183 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.209375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fb14-c0c0-4712-b2c0-3f0627fdc183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.228728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-5855fb14-c0c0-4712-b2c0-3f0627fdc183 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:40.229951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5855fb14-c0c0-4712-b2c0-3f0627fdc183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.239039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1075/2119] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:40.240284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.245540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.245540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.260656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:40.261874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.269909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1076/2120] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:40.270688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.277185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1045/2121] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:40 2022] PUT /identity/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a/users/d27f82af851a454fbcf513be1918fbdf/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:40.278825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.279118 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.283076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.283174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a881-ad9c-4319-8303-877d584720d6 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.299420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:40.300746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.344672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.345354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.345641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.345921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.346666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:40.346977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.348709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.361818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1077/2122] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:40.363228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.365133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.382088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb702a4e-1349-4c83-af98-cd83a010885f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.389802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.390968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.391275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.391561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.392597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.394523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.407262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1078/2123] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:40.408118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.423552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fed51-8748-478c-96a7-958053014465 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.428412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1046/2124] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:40.428412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.440747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.441516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.441985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.442337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.443048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.445922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.454976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219dd3-f2d4-4ecd-8f94-162042d4b690 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.463922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.464960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.465232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.465513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] PATH_INFO: `/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a/users/d27f82af851a454fbcf513be1918fbdf/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.468154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e2f28055e74fb5bf3bfb5d0c53238a, user_id=d27f82af851a454fbcf513be1918fbdf, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.471166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.495725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1047/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:40 2022] PUT /identity/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a/users/d27f82af851a454fbcf513be1918fbdf/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:40.495725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.564478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e9c8f-3db7-4b75-8652-2cbb1875e379 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.569440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.570637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.571096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.571585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.572327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:40.572665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.574267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e672b6-07bd-410c-833a-556e75527ae0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.589549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1048/2126] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:40.594292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.594591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.595657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.601826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1079/2127] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:40.603066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.659011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] MFA Rules not processed for user `d27f82af851a454fbcf513be1918fbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:40.660226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:40.716068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef03b5-895c-4553-afc8-3d38dcc7b10d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.723685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.724459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.724871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.725252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.726095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.728316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.790061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1049/2128] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:40.790061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.801610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef965-6eaf-428d-8df4-cca1971025c7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.807070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.807874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.808258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.808680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.809531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.812003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.860169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1080/2129] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:40.861523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.905220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1050/2130] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:40.915304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.928013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:40.943238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5494584-fd5c-4c3c-b184-832611f6f514 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.950656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.951785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.952342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.959710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.959710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.959710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.960539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb0e5-abdf-44e3-a81f-2b0ad763e54a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:40.970631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:40.971449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:40.971706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:40.972021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:40.972829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:40.974758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:40.990299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1051/2131] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:40.991415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:40.994608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:41.065624 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1081/2132] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:40 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:41.067141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.072440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915f06d-11e1-40b9-bd2a-2fe828fb8603 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.076928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.077666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.078022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.078376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.079920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb003-35bd-4143-b92c-e3bebb797d6e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.087078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.087755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.088040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.088536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.089059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.090864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.105035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1082/2133] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:41.105035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.116638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83a67-7552-43b6-bffb-dad00b2f51de admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.122445 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.123109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.123392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.123670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.124434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.126702 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.138890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1083/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:41.140065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.145888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.147333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.150243 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028616-1c98-465a-b45d-704c0072b078 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.155410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.156300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.156639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.156958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] PATH_INFO: `/v3/projects/74d1d3f132054df49827a7be6205eba2/users/05949e28eb9b498f9c50358ab6a7ec6d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.158602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1052/2135] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:41.159443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.172137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae400c7-0906-4e4f-a820-cdcb0a02eb6e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.175559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d1d3f132054df49827a7be6205eba2, user_id=05949e28eb9b498f9c50358ab6a7ec6d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.182060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.182060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.182060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.182060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.182385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8046c86-6da0-49fe-bc1b-0b567893959e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.182468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.182468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.192129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1053/2136] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:41.196436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.205930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909fca0-a3fd-49b2-ac9d-5314c24b1e05 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.210491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.211427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.211705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.211980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] PATH_INFO: `/v3/projects/309adfa37c76490f97b5758273bd62a7/users/6e4d507689e94a7fa40604fc934c4aaf/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.226893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=309adfa37c76490f97b5758273bd62a7, user_id=6e4d507689e94a7fa40604fc934c4aaf, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.229669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e800d-5982-4285-b1f1-ea1ff79cf15b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.294554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1084/2137] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:41 2022] PUT /identity/v3/projects/74d1d3f132054df49827a7be6205eba2/users/05949e28eb9b498f9c50358ab6a7ec6d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:41.314431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.314729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.315000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.325964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1054/2138] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:41 2022] PUT /identity/v3/projects/309adfa37c76490f97b5758273bd62a7/users/6e4d507689e94a7fa40604fc934c4aaf/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:41.344107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.344424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.344756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.358820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] MFA Rules not processed for user `05949e28eb9b498f9c50358ab6a7ec6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:41.360040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:41.382874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] MFA Rules not processed for user `6e4d507689e94a7fa40604fc934c4aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:41.384696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:41.467065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1085/2139] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:41.467965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.489355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1055/2140] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:41.490287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.534791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06bee7-913e-4552-8998-7f0f20d2efa8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.538987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.540382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.540695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.540968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.543693 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:41.561605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d512b-47e4-4e94-adc3-b874b3cc0dfa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.566446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.567112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.567392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.567665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.568360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.570632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.610102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:41.612888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.616028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.627359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1086/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:41.628897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.641540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630eea6-3867-462a-af71-24dc5d202e57 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.646440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.647204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.647646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.647824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.649968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.652137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.769428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1056/2142] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:41.773556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.792404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1087/2143] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:41.804184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:41.838321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120508-08bc-4bbd-a53d-bea4738fe3a7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.870467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113800-410b-4b0e-8831-98c23d2021eb admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:41.875524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.876200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.876508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.876787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.877477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.879412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.902235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:41.903055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:41.903451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:41.903927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:41.904888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:41.907070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:41.999390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1088/2144] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:42.003163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.013712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f4c6-8fa5-4242-a5db-986c12248b01 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.018716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.019382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.019669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.019949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.020739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.022459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.032355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1089/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:42.036620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.047218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8fe4b-8ee7-4d0d-9a03-ae7fd3205421 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.050545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1057/2146] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:41 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:42.054101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.056135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.057067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.077792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.077792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] PATH_INFO: `/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4/users/3fa66e45a7a04a59a3d420d62d82bd4e/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.078386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fe29-bc36-4527-990a-d7a59c34516e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.078386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.078386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.078386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.078697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.078697 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.078842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca41ad3e32b456da5ee0b693ae485c4, user_id=3fa66e45a7a04a59a3d420d62d82bd4e, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.078923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.079002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.087040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1058/2147] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:42.091119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.101305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ab1d-1a86-48ae-bb76-ad1b77cf7c84 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.106780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.107814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.112215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.112215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] PATH_INFO: `/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36/users/6920ea507cd94beb9eb65403c8c378ca/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.124700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02990c663c7e44e9bdd46a1ab87a0b36, user_id=6920ea507cd94beb9eb65403c8c378ca, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.127394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.183687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1090/2148] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:42 2022] PUT /identity/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4/users/3fa66e45a7a04a59a3d420d62d82bd4e/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:42.184700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.248429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde01e-d154-4555-a84a-d956dacfaf5f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.253568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.254231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.254512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.254784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.255506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.257130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.267156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1091/2149] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:42.268292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:42.272931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.275115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1059/2150] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:42 2022] PUT /identity/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36/users/6920ea507cd94beb9eb65403c8c378ca/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:42.278939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.287264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fcd6-2ccc-423b-b6e4-7e80e9405398 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.362317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790cca-c9ba-4447-9ae5-c0a111a13b4b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.369125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.369591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.370348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.370710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.371101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.371638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.371911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.372117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.372332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] PATH_INFO: `/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4/users/3fa66e45a7a04a59a3d420d62d82bd4e/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.373920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.375672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca41ad3e32b456da5ee0b693ae485c4, user_id=3fa66e45a7a04a59a3d420d62d82bd4e, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.378577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b92f3-6b01-46a0-82e4-18d4af2aef57 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.392398 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1060/2151] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:42.392927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1092/2152] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:42 2022] PUT /identity/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4/users/3fa66e45a7a04a59a3d420d62d82bd4e/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:42.393742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.405102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15c416-2755-46e4-9a85-ce1fa1d1d704 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.408132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33e564-f0b2-4fd0-b63c-c932e1984167 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.408535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33e564-f0b2-4fd0-b63c-c932e1984167 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.408802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33e564-f0b2-4fd0-b63c-c932e1984167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.470161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ad33e564-f0b2-4fd0-b63c-c932e1984167 None None] MFA Rules not processed for user `3fa66e45a7a04a59a3d420d62d82bd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:42.471392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ad33e564-f0b2-4fd0-b63c-c932e1984167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:42.490991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.492069 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.492558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.493042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] PATH_INFO: `/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36/users/6920ea507cd94beb9eb65403c8c378ca/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.495321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02990c663c7e44e9bdd46a1ab87a0b36, user_id=6920ea507cd94beb9eb65403c8c378ca, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.498549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.510897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1061/2153] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:42 2022] PUT /identity/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36/users/6920ea507cd94beb9eb65403c8c378ca/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:42.520101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.520101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:42.596667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1093/2154] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:42.601188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.604692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.604692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.620644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7844f-ac91-4cc8-bc25-ee460400b355 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.626797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.627562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.627844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.628119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] PATH_INFO: `/v3/users/12fbe50c0d0c4b93b2e54856c8f296fe` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.629766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fbe50c0d0c4b93b2e54856c8f296fe)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.639531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.643665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] MFA Rules not processed for user `6920ea507cd94beb9eb65403c8c378ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:42.645277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:42.732306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1094/2155] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:42.737057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.737057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:42.799661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c2bb1-d9dc-4053-ad26-e95e5c135ca4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.803538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.804193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.804480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.804816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.866092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.867751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.877286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1095/2156] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:42.878067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:42.886419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc35e0e-aae2-4029-89dd-0d516c0b56e4 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:42.890181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:42.890818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:42.891219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:42.891500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:42.902891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:42.904474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46ec62-3bc7-4cb9-93b4-18e871e54a76 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:42.916140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1096/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:42.928414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fbe50c0d0c4b93b2e54856c8f296fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:42.929174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fbe50c0d0c4b93b2e54856c8f296fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:42.931156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fbe50c0d0c4b93b2e54856c8f296fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:42.943399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fbe50c0d0c4b93b2e54856c8f296fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:42.951277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fbe50c0d0c4b93b2e54856c8f296fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.056846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1062/2158] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:42 2022] DELETE /identity/v3/users/12fbe50c0d0c4b93b2e54856c8f296fe => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:43.060791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.061046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.061328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.068450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:43.070021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.086496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:43.089732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:43.090628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.154782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b949-d38d-468c-af6f-7c6c2947a892 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:43.157339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1097/2159] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:43.159797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:43.162205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.162205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.162205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] PATH_INFO: `/v3/users/05949e28eb9b498f9c50358ab6a7ec6d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.163250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05949e28eb9b498f9c50358ab6a7ec6d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:43.165711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:43.170296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:43.171948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.249082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97556603-18ac-4947-a32c-17e68c34f10f None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:43.252993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:43.253733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.254026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.254302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.265168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:43.266619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:43.277816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1098/2160] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:43.278656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:43.279937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.348623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3beffd-057c-4081-8d2b-76da0c0f6a27 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:43.353246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:43.353919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.354187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.354706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.356632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.418335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05949e28eb9b498f9c50358ab6a7ec6d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.419049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05949e28eb9b498f9c50358ab6a7ec6d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.419772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05949e28eb9b498f9c50358ab6a7ec6d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.426751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:43.432392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0f1b7-a9e3-4373-94f2-b8656cf6e094 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:43.435714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:43.438966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05949e28eb9b498f9c50358ab6a7ec6d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.446071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1099/2161] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:43.463470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05949e28eb9b498f9c50358ab6a7ec6d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:43.584590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1063/2162] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:43 2022] DELETE /identity/v3/users/05949e28eb9b498f9c50358ab6a7ec6d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:43.640783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.641275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.641540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.675190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:43.676434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.738846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1100/2163] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:43.752217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:43.753937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.810036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef91af-8472-499a-84f5-c4c415e67a11 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:43.813619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:43.814256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.814537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.814832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.823635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:43.829485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:43.834340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1064/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:43.944886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:43.944886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:43.957814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af04a5d-4bd2-4a68-be64-e57869506c2a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:43.964641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:43.966234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:43.966603 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:43.967133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] PATH_INFO: `/v3/projects/0fd77a7bd9bb41e6acc42bbd657de0f1` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:43.968535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd77a7bd9bb41e6acc42bbd657de0f1)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:43.985226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:44.150543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd77a7bd9bb41e6acc42bbd657de0f1', 'request_id': 'req-ca08489b-ae56-4f63-a6e5-864ddde8fc30'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.159266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd77a7bd9bb41e6acc42bbd657de0f1', 'request_id': 'req-ca08489b-ae56-4f63-a6e5-864ddde8fc30'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.236951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd77a7bd9bb41e6acc42bbd657de0f1', 'request_id': 'req-ca08489b-ae56-4f63-a6e5-864ddde8fc30'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.252773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] The token cache is being invalidate because project 0fd77a7bd9bb41e6acc42bbd657de0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:44.253367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.253819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.255983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1101/2165] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:43 2022] DELETE /identity/v3/projects/0fd77a7bd9bb41e6acc42bbd657de0f1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:44.261071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:44.272682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f0843-196b-4cb5-a163-91e3e2e92f2d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:44.363817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:44.365303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:44.365864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:44.366151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] PATH_INFO: `/v3/users/d76b6f782c804a09b54b53ec2ad26e4f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:44.367549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76b6f782c804a09b54b53ec2ad26e4f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:44.369821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:44.422007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:44.422007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:44.434643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08489b-ae56-4f63-a6e5-864ddde8fc30 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:44.447732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:44.448664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:44.449406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:44.449691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] PATH_INFO: `/v3/projects/74d1d3f132054df49827a7be6205eba2` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:44.450957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d1d3f132054df49827a7be6205eba2)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:44.452915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:44.656798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76b6f782c804a09b54b53ec2ad26e4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.657468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76b6f782c804a09b54b53ec2ad26e4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.658191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76b6f782c804a09b54b53ec2ad26e4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.659377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d1d3f132054df49827a7be6205eba2', 'request_id': 'req-d634361b-4669-43c7-ab8a-31e3d0517019'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.666644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d1d3f132054df49827a7be6205eba2', 'request_id': 'req-d634361b-4669-43c7-ab8a-31e3d0517019'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.672511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76b6f782c804a09b54b53ec2ad26e4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.679433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76b6f782c804a09b54b53ec2ad26e4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.785486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d1d3f132054df49827a7be6205eba2', 'request_id': 'req-d634361b-4669-43c7-ab8a-31e3d0517019'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.797240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] The token cache is being invalidate because project 74d1d3f132054df49827a7be6205eba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:44.797530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.798181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:44.799773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1102/2166] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:44 2022] DELETE /identity/v3/projects/74d1d3f132054df49827a7be6205eba2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:44.803499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:44.804909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:44.870957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634361b-4669-43c7-ab8a-31e3d0517019 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:44.876228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:44.877173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:44.877461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:44.877738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] PATH_INFO: `/v3/users/6920ea507cd94beb9eb65403c8c378ca` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:44.878853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:44.879041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6920ea507cd94beb9eb65403c8c378ca)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:44.880994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:44.889387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1065/2167] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:44 2022] DELETE /identity/v3/users/d76b6f782c804a09b54b53ec2ad26e4f => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:45.144150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:45.223297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6920ea507cd94beb9eb65403c8c378ca'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.223970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6920ea507cd94beb9eb65403c8c378ca'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.224621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6920ea507cd94beb9eb65403c8c378ca'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.242409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6920ea507cd94beb9eb65403c8c378ca'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.250856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6920ea507cd94beb9eb65403c8c378ca'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.345613 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:45.351277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:45.415513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60b7b-d512-4a6b-9fc0-8eda181aac32 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:45.420343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:45.421241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:45.421526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:45.421798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] PATH_INFO: `/v3/projects/841cde2a4a16497795a77fa40ee713f5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:45.423025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=841cde2a4a16497795a77fa40ee713f5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:45.424978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:45.436169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1103/2168] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:44 2022] DELETE /identity/v3/users/6920ea507cd94beb9eb65403c8c378ca => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:45.683729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841cde2a4a16497795a77fa40ee713f5', 'request_id': 'req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.690046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841cde2a4a16497795a77fa40ee713f5', 'request_id': 'req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.696464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841cde2a4a16497795a77fa40ee713f5', 'request_id': 'req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.839197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] The token cache is being invalidate because project 841cde2a4a16497795a77fa40ee713f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:45.839856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.840873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:45.843033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1066/2169] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:45 2022] DELETE /identity/v3/projects/841cde2a4a16497795a77fa40ee713f5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:45.846935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:45.848914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:45.936307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a448f-111d-41c7-b7f5-75952116f5b9 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:45.996037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:45.996989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:45.997276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:45.997574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] PATH_INFO: `/v3/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:45.998801 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5e5a2eaf444e18a0c2f9c43cbfdb52)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:46.002299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:46.053824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:46.055625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:46.068551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08d8-2f0e-4c86-828b-4c39598f5cbb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:46.073410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:46.081064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.081064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.081064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] PATH_INFO: `/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.085671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=02990c663c7e44e9bdd46a1ab87a0b36)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:46.088298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:46.299094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5e5a2eaf444e18a0c2f9c43cbfdb52'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.299745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5e5a2eaf444e18a0c2f9c43cbfdb52'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.300350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5e5a2eaf444e18a0c2f9c43cbfdb52'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.304568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02990c663c7e44e9bdd46a1ab87a0b36', 'request_id': 'req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.311956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02990c663c7e44e9bdd46a1ab87a0b36', 'request_id': 'req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.318099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02990c663c7e44e9bdd46a1ab87a0b36', 'request_id': 'req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.328200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5e5a2eaf444e18a0c2f9c43cbfdb52'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.332169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5e5a2eaf444e18a0c2f9c43cbfdb52'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.431194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] The token cache is being invalidate because project 02990c663c7e44e9bdd46a1ab87a0b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:46.432386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.433774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5a3013ef-edfd-4b00-b3a4-50056f0fa3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:46.436013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1067/2170] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:46 2022] DELETE /identity/v3/projects/02990c663c7e44e9bdd46a1ab87a0b36 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:46.440855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8705-e70a-49e7-b18d-fe80dc965d86 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.441424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8705-e70a-49e7-b18d-fe80dc965d86 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.441967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8705-e70a-49e7-b18d-fe80dc965d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.468273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-363a8705-e70a-49e7-b18d-fe80dc965d86 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:46.469762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-363a8705-e70a-49e7-b18d-fe80dc965d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:46.532329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1104/2171] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:45 2022] DELETE /identity/v3/users/5d5e5a2eaf444e18a0c2f9c43cbfdb52 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:46.532329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:46.532329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:46.545999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1068/2172] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:46.556802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.557241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.566415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.632431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:46.637760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:46.745796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1069/2173] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:46.750000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:46.752814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195f2a-f428-4f9b-8cb7-8df88759be49 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:46.760017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c33a88-c833-4b6e-8ce2-36f017837ac6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:46.764042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:46.769783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:46.770148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.770148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.770333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.770449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] PATH_INFO: `/v3/users/41cccabeec434f2cb45482138001a606` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.770550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.770550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.770550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:46.770550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:46.770869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41cccabeec434f2cb45482138001a606)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:46.770973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:46.772713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:46.790695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1070/2174] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:37:46.791759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:46.802787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4684-5d9d-4425-b8ed-a2abf44925b9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:46.808932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:46.809763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:46.810049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:46.810403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:46.811264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:46.813532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:46.883161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:46.927600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1071/2175] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:46 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:46.931765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.021923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325afa40-347d-49d6-8f50-fa895758f619 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.026973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.027644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.027923 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.028198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.029085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.031056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.053791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41cccabeec434f2cb45482138001a606'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.053791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41cccabeec434f2cb45482138001a606'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.053791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41cccabeec434f2cb45482138001a606'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.065640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41cccabeec434f2cb45482138001a606'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.073407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41cccabeec434f2cb45482138001a606'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.161390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1072/2176] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:46 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:47.167218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.169662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.188213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:47.191178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe06d-6b80-4707-b019-614dfcb97304 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.197257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1105/2177] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:46 2022] DELETE /identity/v3/users/41cccabeec434f2cb45482138001a606 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:47.197257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.201019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.209150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.210487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.210778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.211058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] PATH_INFO: `/v3/projects/242c3f159c9c4532af435cae3513376a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.213207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=242c3f159c9c4532af435cae3513376a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.216654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.276786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3fe6-7bf2-42f8-9936-d75bedc9be84 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.292703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.292703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.292703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.292703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.293348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.293348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640ccb-2405-4498-9340-fde25a7f564f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.297465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1106/2178] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:47.299540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.300045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.300575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.321071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:47.322449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.334415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1107/2179] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:47.336193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.357107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242c3f159c9c4532af435cae3513376a', 'request_id': 'req-d71906e0-40b2-4972-b343-a70a27a4b32e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.359492 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367051-77f3-4232-b9a3-bbb323cc5cee None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.366369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242c3f159c9c4532af435cae3513376a', 'request_id': 'req-d71906e0-40b2-4972-b343-a70a27a4b32e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.399390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242c3f159c9c4532af435cae3513376a', 'request_id': 'req-d71906e0-40b2-4972-b343-a70a27a4b32e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.425175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.426037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.426465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.426840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.427676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.429475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.443920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1108/2180] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:47.444873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.448550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.520127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] The token cache is being invalidate because project 242c3f159c9c4532af435cae3513376a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:47.520127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.520127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:47.520753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1073/2181] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:47 2022] DELETE /identity/v3/projects/242c3f159c9c4532af435cae3513376a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:47.521640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.522934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.538662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71906e0-40b2-4972-b343-a70a27a4b32e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.551913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74403-f0dd-497a-8e9b-f407b42d88c5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.557850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.558740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.559202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.559767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.559909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.562726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.563017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.563133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.563291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] PATH_INFO: `/v3/projects/2dd4f3888c7f4f529f5a1662a2bde525/users/419f3a6e6ef040bc814c0584b3489645/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.580707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.582164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b4b-e72f-484a-b029-82af8771df48 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.594986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd4f3888c7f4f529f5a1662a2bde525, user_id=419f3a6e6ef040bc814c0584b3489645, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.596739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1109/2182] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:47.598048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fe5a-6d97-4a5e-8b83-d14617a42ab5 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.598166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1c217-f91e-4f02-8b6c-c35a6f275cbc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.598351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fe5a-6d97-4a5e-8b83-d14617a42ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.598622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fe5a-6d97-4a5e-8b83-d14617a42ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.623653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-49c4fe5a-6d97-4a5e-8b83-d14617a42ab5 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:47.624985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-49c4fe5a-6d97-4a5e-8b83-d14617a42ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.634461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1110/2183] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:47.643410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.643699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.643984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.662632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:47.664222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.674012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1111/2184] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:47.678031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.687281 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d9d4e-3e02-4744-949d-48fa46c5765e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.692092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.692725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.693010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.693286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.694012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:47.694317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.695918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.711616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1112/2185] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:47.713641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.723798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102985-1928-40f4-b61b-aed7dfd49616 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:47.729407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:47.730371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.730841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.731180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.731883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:47.733906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:47.757669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1074/2186] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:47 2022] PUT /identity/v3/projects/2dd4f3888c7f4f529f5a1662a2bde525/users/419f3a6e6ef040bc814c0584b3489645/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:47.768064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:47.768336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:47.768658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:47.795373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] MFA Rules not processed for user `419f3a6e6ef040bc814c0584b3489645`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:47.796637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:47.850774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1113/2187] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:47.855706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:47.905627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1075/2188] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:47.911547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.010710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e36f3-f6dd-49b0-b4fc-7218e7d53507 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.016189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.016881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.017272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.017433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.018171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.021163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.028205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b4e60-4992-41a6-b214-c2695eafe059 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.046794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.047534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.047844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.048152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.049037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.050871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.123886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1076/2189] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:48.127898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.198383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1114/2190] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:47 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:48.199302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.212694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3ce3-5464-451e-be74-f696c96caebe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.222810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34ecf-a479-4a4b-a178-99c2d87b4dc9 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.222951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.222951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.222951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.222951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.223290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.223371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.223492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.223573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.223573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.223573 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.224010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.226429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.243728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1115/2191] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:48.248163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.260214 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dc5cf-ce57-4ae7-954e-3de276f4514f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.265268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.265922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.266205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.266481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.267213 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.268919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.281215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1116/2192] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:48.284913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.296282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28556f-a52a-428b-9325-d6cbab7afbd2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.301446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.302344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.302625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.302961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] PATH_INFO: `/v3/projects/b60b9f54cde341cfb2e126fae67e13ef/users/94d49cbc2d5d458881d3c2a5880f9109/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.324250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1077/2193] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:48 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:48.330112 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60b9f54cde341cfb2e126fae67e13ef, user_id=94d49cbc2d5d458881d3c2a5880f9109, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.332239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.333862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.349316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b66aa-c74f-409b-86ae-ab4d957cda88 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.357555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.358259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.358540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.358951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.359762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.361497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.373634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1078/2194] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:48.377862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.388132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2293d-f084-408f-8e4f-41848c21449c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.393610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.394531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.394794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.395147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] PATH_INFO: `/v3/projects/e76fb54219284c769c67dbed8248dc8f/users/5989f376386d456ba306415cbd89ce82/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.415643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76fb54219284c769c67dbed8248dc8f, user_id=5989f376386d456ba306415cbd89ce82, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.418510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb36578-9f57-4c53-b873-7d1540cfd0ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.476506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1117/2195] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:48 2022] PUT /identity/v3/projects/b60b9f54cde341cfb2e126fae67e13ef/users/94d49cbc2d5d458881d3c2a5880f9109/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:48.477166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.481067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.493717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:48.566034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5886a9-640c-4f23-b4bb-851b90a0022d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.572005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.572864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.577650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.577650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] PATH_INFO: `/v3/projects/a4a8c7ef0d194a8f913b182b0fb52961` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.578432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a8c7ef0d194a8f913b182b0fb52961)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.580921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.596245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1079/2196] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:48 2022] PUT /identity/v3/projects/e76fb54219284c769c67dbed8248dc8f/users/5989f376386d456ba306415cbd89ce82/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:48.596245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.596245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.596245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.623575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:48.624900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.724055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1080/2197] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:48.727617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.739791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad6e1a-7d0d-44fb-b215-87503f8bc784 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.745814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.747933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.747933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.747933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.748213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.749622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.760573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1081/2198] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:48.762239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.764088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.796235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a8c7ef0d194a8f913b182b0fb52961', 'request_id': 'req-4bbeb3b3-e482-48a8-80f5-0105b78243da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:48.803128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a8c7ef0d194a8f913b182b0fb52961', 'request_id': 'req-4bbeb3b3-e482-48a8-80f5-0105b78243da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:48.814241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:48.833774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd9cb-b95e-49b2-a808-943118e15856 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.878074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a8c7ef0d194a8f913b182b0fb52961', 'request_id': 'req-4bbeb3b3-e482-48a8-80f5-0105b78243da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:48.890124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.890836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.891126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.891405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] The token cache is being invalidate because project a4a8c7ef0d194a8f913b182b0fb52961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:48.891566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.891700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:48.892343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:48.894008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1118/2199] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:48 2022] DELETE /identity/v3/projects/a4a8c7ef0d194a8f913b182b0fb52961 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:48.895017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.907680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.911765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.964766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.966252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.976003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb3b3-e482-48a8-80f5-0105b78243da admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:48.976576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1082/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:48.977397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:48.980316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:48.982174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:48.983312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:48.983594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:48.983876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] PATH_INFO: `/v3/projects/e76fb54219284c769c67dbed8248dc8f/users/5989f376386d456ba306415cbd89ce82/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:48.985925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76fb54219284c769c67dbed8248dc8f, user_id=5989f376386d456ba306415cbd89ce82, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:48.989373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94c145-ceba-4a6f-9e78-1ca3fc0dd9e7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:48.992802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d146-2b19-4e9a-99d2-2eff7c7ace9a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:49.000644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:49.009261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1119/2201] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:48 2022] PUT /identity/v3/projects/e76fb54219284c769c67dbed8248dc8f/users/5989f376386d456ba306415cbd89ce82/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:49.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:49.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:49.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] PATH_INFO: `/v3/users/00d772e2b6274814b020568bcd618d73` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:49.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d772e2b6274814b020568bcd618d73)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:49.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:49.010985 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:49.011278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:49.011582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:49.037890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] MFA Rules not processed for user `5989f376386d456ba306415cbd89ce82`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:49.041951 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:49.111954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1120/2202] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:49.158695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:49.160100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:49.255378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213f06-8cdb-4e98-83a1-899067208696 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:49.255657 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d772e2b6274814b020568bcd618d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:49.256178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d772e2b6274814b020568bcd618d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:49.256817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d772e2b6274814b020568bcd618d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:49.259845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:49.260513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:49.260811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:49.261078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:49.263078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:49.272738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d772e2b6274814b020568bcd618d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:49.276981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:49.278484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:49.281342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d772e2b6274814b020568bcd618d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:49.289032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1121/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:37:49.395031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1083/2204] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:48 2022] DELETE /identity/v3/users/00d772e2b6274814b020568bcd618d73 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:49.900859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:49.902937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:49.980560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e84a-0379-43cb-acf4-bc1b3edb8a3a service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:50.037530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:50.038403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:50.038706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:50.039054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] PATH_INFO: `/v3/projects/906a6fbea2504598a4f070c86b19582c` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:50.040314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906a6fbea2504598a4f070c86b19582c)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:50.042417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:50.180958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906a6fbea2504598a4f070c86b19582c', 'request_id': 'req-aec1ee17-5533-42e3-b74b-6fe51fff54b1'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.188187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906a6fbea2504598a4f070c86b19582c', 'request_id': 'req-aec1ee17-5533-42e3-b74b-6fe51fff54b1'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.292965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906a6fbea2504598a4f070c86b19582c', 'request_id': 'req-aec1ee17-5533-42e3-b74b-6fe51fff54b1'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.304844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] The token cache is being invalidate because project 906a6fbea2504598a4f070c86b19582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:50.305137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.305814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.308656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1122/2205] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:49 2022] DELETE /identity/v3/projects/906a6fbea2504598a4f070c86b19582c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:50.312530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:50.322889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03970-8c5a-4e69-80ec-b33cf67f2e4a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:50.381362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:50.382256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:50.382541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:50.382820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] PATH_INFO: `/v3/users/aca26a4969e640f89c4f68aba73a59e6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:50.384196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca26a4969e640f89c4f68aba73a59e6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:50.386350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:50.617825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca26a4969e640f89c4f68aba73a59e6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.619130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca26a4969e640f89c4f68aba73a59e6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.619879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca26a4969e640f89c4f68aba73a59e6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.633573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca26a4969e640f89c4f68aba73a59e6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.641758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca26a4969e640f89c4f68aba73a59e6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:50.750060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:50.751508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:50.764958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1084/2206] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:50 2022] DELETE /identity/v3/users/aca26a4969e640f89c4f68aba73a59e6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:50.837757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1ee17-5533-42e3-b74b-6fe51fff54b1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:50.909171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5989f376386d456ba306415cbd89ce82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76fb54219284c769c67dbed8248dc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:50.910020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:50.910650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:50.911033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:50.911904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:50.912687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:50.914986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:50.932308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1123/2207] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:37:50.933639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:50.935383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:50.950809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862bec5-a5ca-4b67-994b-d50d168786f6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:50.957817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5989f376386d456ba306415cbd89ce82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76fb54219284c769c67dbed8248dc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:50.958651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:50.958955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:50.959309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:50.960093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:50.962934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:50.981356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:51.117364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1085/2208] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:50 2022] POST /identity/v3/projects => generated 353 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:51.122191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:51.132349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72136b5-8287-4364-9829-71d6780cd711 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:51.191180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5989f376386d456ba306415cbd89ce82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76fb54219284c769c67dbed8248dc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:51.191849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:51.192154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:51.192427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:51.193185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:51.193490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:51.195116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:51.207086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1124/2209] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:51.253756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:51.264373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a6e2-a9e0-4d7e-9e3a-049e6fe4a1cc tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:51.279776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5989f376386d456ba306415cbd89ce82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76fb54219284c769c67dbed8248dc8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:51.281191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:51.281497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:51.281778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] PATH_INFO: `/v3/projects/48321e8c3bc0449ba1c82d4900337da7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:51.288607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48321e8c3bc0449ba1c82d4900337da7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:51.294830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:51.341739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:51.430388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48321e8c3bc0449ba1c82d4900337da7', 'request_id': 'req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.439748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48321e8c3bc0449ba1c82d4900337da7', 'request_id': 'req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.452326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48321e8c3bc0449ba1c82d4900337da7', 'request_id': 'req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.543557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:51.544660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] The token cache is being invalidate because project 48321e8c3bc0449ba1c82d4900337da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:51.545121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.546243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c998a30c-b1f4-43f5-8fa6-248d4ee8b699 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.546742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:51.548884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1086/2210] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:51 2022] DELETE /identity/v3/projects/48321e8c3bc0449ba1c82d4900337da7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:51.649558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee0cb9-eb3b-4911-9ab2-a0c40f50be32 tempest-VolumeQuotaClassesTest-358091253 tempest-VolumeQuotaClassesTest-358091253-project-admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:51.742323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:51.744145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:51.744590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:51.745163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] PATH_INFO: `/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:51.746516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f333e4d3eb4e2ea7b1983ca17ab675)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:51.748765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:51.902212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f333e4d3eb4e2ea7b1983ca17ab675', 'request_id': 'req-040d3e1d-f4da-4293-b8d4-38615ea43d19'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.908816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f333e4d3eb4e2ea7b1983ca17ab675', 'request_id': 'req-040d3e1d-f4da-4293-b8d4-38615ea43d19'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:51.989345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f333e4d3eb4e2ea7b1983ca17ab675', 'request_id': 'req-040d3e1d-f4da-4293-b8d4-38615ea43d19'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.005808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] The token cache is being invalidate because project 58f333e4d3eb4e2ea7b1983ca17ab675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:52.006188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.007168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-040d3e1d-f4da-4293-b8d4-38615ea43d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.009440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1125/2211] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:51 2022] DELETE /identity/v3/projects/58f333e4d3eb4e2ea7b1983ca17ab675 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:52.015146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.021556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.021556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.038104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:52.039485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:52.106970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1087/2212] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:52.115092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.115379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.115655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.135274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:52.136716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:52.147040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1126/2213] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:52.156741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.168928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84a0e-327c-4aa4-86e1-6afd28ee80b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.183119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.184479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.184852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.185130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.185878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:52.186189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.190294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.218151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1088/2214] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:37:52.222132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.235931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd519e11-0dfe-46ca-b0ad-be3c9d5d7754 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.241647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.242319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.242606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.242884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.243584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.246434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.343198 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.345468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:52.370930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d10d40-5c62-4dd2-8640-df76f3b8676b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.386861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.387970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.388408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.388977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] PATH_INFO: `/v3/users/419f3a6e6ef040bc814c0584b3489645` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.391066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=419f3a6e6ef040bc814c0584b3489645)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.391712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1127/2215] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:52.394423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.395868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.510851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f545d-4c44-4e9a-893c-9e6bffd5832e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.517290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.518300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.518626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.519202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.520083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.522660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.646760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1128/2216] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:37:52.650987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.669579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a459c8-473a-497b-998d-5813d7cd4aae admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.684520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.685355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.685649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.685930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.687841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.690082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.708008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1129/2217] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:37:52.712806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.730870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad774-0910-43e3-a5ff-c42650c3851b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.734175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419f3a6e6ef040bc814c0584b3489645'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.735533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419f3a6e6ef040bc814c0584b3489645'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.736368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419f3a6e6ef040bc814c0584b3489645'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.737562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.738465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.738749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.739240 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.741302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.743808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.759304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419f3a6e6ef040bc814c0584b3489645'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.763242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1130/2218] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:52.766843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:52.767930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5c59619b-a43e-4a68-98e5-d8148ca2e65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419f3a6e6ef040bc814c0584b3489645'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:52.769089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:52.783221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17917687-4ee4-4430-945c-0c62f918d95f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:52.787979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:52.788920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.789198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.789469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] PATH_INFO: `/v3/projects/30a312a8c613442a99687f128cc29644/users/0521c6c333cb4cdf8cc8e9daa3ae5993/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.822739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a312a8c613442a99687f128cc29644, user_id=0521c6c333cb4cdf8cc8e9daa3ae5993, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:52.827487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe4cc-3389-418c-a8af-f1bee7fc8e94 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:52.879245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1089/2219] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:52 2022] DELETE /identity/v3/users/419f3a6e6ef040bc814c0584b3489645 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:52.885305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.885678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.886138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:52.920757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:52.923440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1131/2220] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:52 2022] PUT /identity/v3/projects/30a312a8c613442a99687f128cc29644/users/0521c6c333cb4cdf8cc8e9daa3ae5993/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:52.924720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:52.934867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:52.935228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:52.935594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:53.003914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] MFA Rules not processed for user `0521c6c333cb4cdf8cc8e9daa3ae5993`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:53.006418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:53.017099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1090/2221] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:53.033566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:53.035106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:53.131595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1132/2222] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:53.133954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f01e4-de87-481c-815a-fb5bbea63c91 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:53.139434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:53.140082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:53.140671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:53.140880 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:53.145583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:53.147200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:53.152294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:53.154009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:53.164450 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1091/2223] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:53.218478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eea41-a253-4265-87b3-f5465c011731 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:53.224184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:53.225353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:53.225642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:53.225924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:53.239313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:53.241738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:53.255929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1133/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:53.851382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:53.852903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:53.872978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86acd9-4d04-4611-a5a8-8cd9961a6059 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:53.879245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:53.880439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:53.881121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:53.881584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] PATH_INFO: `/v3/projects/2dd4f3888c7f4f529f5a1662a2bde525` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:53.883029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd4f3888c7f4f529f5a1662a2bde525)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:53.885227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:54.066500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:54.071090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd4f3888c7f4f529f5a1662a2bde525', 'request_id': 'req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.080211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd4f3888c7f4f529f5a1662a2bde525', 'request_id': 'req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.088867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd4f3888c7f4f529f5a1662a2bde525', 'request_id': 'req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.216570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] The token cache is being invalidate because project 2dd4f3888c7f4f529f5a1662a2bde525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:54.216922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.219121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.221135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1092/2225] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:53 2022] DELETE /identity/v3/projects/2dd4f3888c7f4f529f5a1662a2bde525 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:54.225094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:54.243535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0ab0-b0e9-4b9c-9248-184bdb2cc4d6 service glance] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:54.355394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:54.356741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:54.357191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:54.357631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] PATH_INFO: `/v3/users/5989f376386d456ba306415cbd89ce82` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:54.359337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5989f376386d456ba306415cbd89ce82)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:54.360188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:54.361737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:54.362196 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:54.378858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569351c8-9a80-4ed3-8332-0f6a43a0fb2e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:54.390219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:54.390858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:54.392140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:54.392428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:54.392728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] PATH_INFO: `/v3/users/96ea9ef3d422419ca84e4caf0f6e9d8d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:54.397128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ea9ef3d422419ca84e4caf0f6e9d8d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:54.399106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:54.648429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5989f376386d456ba306415cbd89ce82'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.649457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5989f376386d456ba306415cbd89ce82'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.649971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5989f376386d456ba306415cbd89ce82'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.678383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ea9ef3d422419ca84e4caf0f6e9d8d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.679536 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ea9ef3d422419ca84e4caf0f6e9d8d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.679953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5989f376386d456ba306415cbd89ce82'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.680156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ea9ef3d422419ca84e4caf0f6e9d8d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.693261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f60aac6a-6c16-4b2e-90ec-7db77f1cb891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5989f376386d456ba306415cbd89ce82'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.705827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ea9ef3d422419ca84e4caf0f6e9d8d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.726347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ea9ef3d422419ca84e4caf0f6e9d8d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:54.857089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1134/2226] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:54 2022] DELETE /identity/v3/users/5989f376386d456ba306415cbd89ce82 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:54.948717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1093/2227] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:54 2022] DELETE /identity/v3/users/96ea9ef3d422419ca84e4caf0f6e9d8d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:37:54.953143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:54.953933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:54.954720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:54.985938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:54.987204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:55.082941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1135/2228] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:37:55.092061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:55.094042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:55.214165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c55e-4c13-499f-b71e-f0d3d7869b18 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:55.219661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:55.220902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:55.221213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:55.221493 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:55.243465 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:55.243465 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:55.322159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1094/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:55.888268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:55.889843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:55.940195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915605c-65b4-482d-8501-cb64d90faa38 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:55.945886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:55.947030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:55.947556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:55.947989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] PATH_INFO: `/v3/projects/e76fb54219284c769c67dbed8248dc8f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:55.949549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76fb54219284c769c67dbed8248dc8f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:55.951655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:56.126908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76fb54219284c769c67dbed8248dc8f', 'request_id': 'req-cec755bb-72bd-4368-99af-0997003d1a7b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.134271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76fb54219284c769c67dbed8248dc8f', 'request_id': 'req-cec755bb-72bd-4368-99af-0997003d1a7b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.231523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76fb54219284c769c67dbed8248dc8f', 'request_id': 'req-cec755bb-72bd-4368-99af-0997003d1a7b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.252638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] The token cache is being invalidate because project e76fb54219284c769c67dbed8248dc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:56.252946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.258151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-cec755bb-72bd-4368-99af-0997003d1a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.266256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1136/2230] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:55 2022] DELETE /identity/v3/projects/e76fb54219284c769c67dbed8248dc8f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:56.267466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:56.270700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.270995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb00c-1ecb-419c-92ff-045eaac74e7d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.271291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb00c-1ecb-419c-92ff-045eaac74e7d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.271578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb00c-1ecb-419c-92ff-045eaac74e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.306479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fb4e-1c9a-458d-9933-4f9db51b360e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:56.333794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1a2cb00c-1ecb-419c-92ff-045eaac74e7d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:56.342272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1a2cb00c-1ecb-419c-92ff-045eaac74e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.445019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1137/2231] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:56.448609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:56.450065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.450354 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.450669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] PATH_INFO: `/v3/projects/d8b7ee26408a493595365909e8ae27e0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.452000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b7ee26408a493595365909e8ae27e0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:56.454647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:56.457550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731fcb-1a94-428e-9926-39c7a7cf503d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.458497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731fcb-1a94-428e-9926-39c7a7cf503d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.458931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b731fcb-1a94-428e-9926-39c7a7cf503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.498376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9b731fcb-1a94-428e-9926-39c7a7cf503d None None] MFA Rules not processed for user `94d49cbc2d5d458881d3c2a5880f9109`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:56.499659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9b731fcb-1a94-428e-9926-39c7a7cf503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.592680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1138/2232] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:56.594034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.594328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.594733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.622322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:56.623643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.624081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b7ee26408a493595365909e8ae27e0', 'request_id': 'req-7ff2e1eb-6522-4cfe-b439-917567c552f2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.636746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b7ee26408a493595365909e8ae27e0', 'request_id': 'req-7ff2e1eb-6522-4cfe-b439-917567c552f2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.646113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b7ee26408a493595365909e8ae27e0', 'request_id': 'req-7ff2e1eb-6522-4cfe-b439-917567c552f2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.696989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1139/2233] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:56.697865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:56.699513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.712767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9aa8c-fd75-461e-9871-0a5be75d2454 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:56.718387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:56.719095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.719381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.719889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.720743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:56.722904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:56.743876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] The token cache is being invalidate because project d8b7ee26408a493595365909e8ae27e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:56.746087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.747420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:56.750367 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1095/2234] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:56 2022] DELETE /identity/v3/projects/d8b7ee26408a493595365909e8ae27e0 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:56.751400 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:56.755983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.784141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2e1eb-6522-4cfe-b439-917567c552f2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:56.796004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:56.798810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.799181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.799541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.800382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:56.804837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:56.806672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:56.825217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1096/2235] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:56.826473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:56.830369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.844842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1140/2236] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:56 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:56.846001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:56.847976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:56.848184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f502a-5f0a-45c2-8785-91671b70182d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:56.931776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:56.933569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.934078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.934913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] PATH_INFO: `/v3/users/d27f82af851a454fbcf513be1918fbdf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.936442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27f82af851a454fbcf513be1918fbdf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:56.939020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:56.982947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fabbc5-6a78-4573-985a-33f4b48a58c7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:56.989380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:56.993198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:56.993743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:56.994207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] PATH_INFO: `/v3/users/826cacdea2404aa4b8dde687fd522780` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:56.998210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=826cacdea2404aa4b8dde687fd522780)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.000576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.201389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:57.214463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27f82af851a454fbcf513be1918fbdf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.215263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27f82af851a454fbcf513be1918fbdf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.215909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27f82af851a454fbcf513be1918fbdf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.227485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27f82af851a454fbcf513be1918fbdf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.234929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27f82af851a454fbcf513be1918fbdf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.302800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826cacdea2404aa4b8dde687fd522780'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.303441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826cacdea2404aa4b8dde687fd522780'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.304037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826cacdea2404aa4b8dde687fd522780'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.316221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826cacdea2404aa4b8dde687fd522780'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.318666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1097/2237] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:56 2022] DELETE /identity/v3/users/d27f82af851a454fbcf513be1918fbdf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:57.319763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.321063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.324226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826cacdea2404aa4b8dde687fd522780'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:57.424328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1141/2238] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:56 2022] DELETE /identity/v3/users/826cacdea2404aa4b8dde687fd522780 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:57.425485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.433716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.440601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6e3-1d4c-4da7-bea3-ee393f9b8456 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.486777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:57.518764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.518764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.518764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.518764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.519144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.522178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406cf08-383b-4804-ad10-8a1cf2eb06f8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.556291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1733-0f1c-484e-a1e3-bbe573b571ec admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.568042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.569371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.569727 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.570134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.571950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.575549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.642382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1098/2239] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:57 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:57.644693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.644693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.644693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.662543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:57.663719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.725413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1142/2240] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:57 2022] POST /identity/v3/users => generated 296 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:57.728285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1099/2241] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:57.729218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.730792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.732615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.742667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464d4db-e880-470a-849c-4b0091eebec1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.743539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430089b4-ba92-4229-b125-c2bd36f0d59b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.747692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.748359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.748682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.748848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.748972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.749474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.749709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.749803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.750043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.750745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.751318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.752755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.771026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1100/2242] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:57.771026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.771026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.829987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb86cf-2ed5-4ac0-b041-61d1e916c311 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.846087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.846087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.846087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.846087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.884317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1143/2243] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:57 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:57.884317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.884915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.884915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.893062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b8ce8-ec90-406b-a842-f42c122be3f6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.897739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1101/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:37:57.898973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.899582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:57.899968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.900268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.900609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] PATH_INFO: `/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519/users/0d8ddc6b91004bfab9f53bb491d4f477/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.903352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:57.924687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ae9bb96c8448f2a33a685ac0eb4519, user_id=0d8ddc6b91004bfab9f53bb491d4f477, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.925772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab749920-4be9-4074-969c-823e78defb0e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:57.928434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:57.931804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:57.933807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:57.934094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:57.934368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] PATH_INFO: `/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:57.935767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e2f28055e74fb5bf3bfb5d0c53238a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:57.938755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.112934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1144/2245] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:57 2022] PUT /identity/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519/users/0d8ddc6b91004bfab9f53bb491d4f477/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:58.113873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.127636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e2f28055e74fb5bf3bfb5d0c53238a', 'request_id': 'req-3114152c-74ac-4323-95e2-131bdf100d16'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.134589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e2f28055e74fb5bf3bfb5d0c53238a', 'request_id': 'req-3114152c-74ac-4323-95e2-131bdf100d16'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.141611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e2f28055e74fb5bf3bfb5d0c53238a', 'request_id': 'req-3114152c-74ac-4323-95e2-131bdf100d16'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.265279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] The token cache is being invalidate because project 02e2f28055e74fb5bf3bfb5d0c53238a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:58.265779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.266749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.270135 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1102/2246] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:57 2022] DELETE /identity/v3/projects/02e2f28055e74fb5bf3bfb5d0c53238a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:58.273081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.278009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:58.290952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542cf9-cf95-41b9-8188-b25762a1bbb7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.397721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.398499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.398858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.399185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.400063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.402894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667bc88-a88e-4fa8-ad55-197e6b426036 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.412625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114152c-74ac-4323-95e2-131bdf100d16 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.415825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1145/2247] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:58.418146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.435827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.435827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.436063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.436063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.436063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.436063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.436418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.436418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.448311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1103/2248] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:58.450528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:58.452619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.453293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:58.454508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:58.468979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1146/2249] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:58.470082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.472935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348327e-b67c-4685-a6b4-4096265351f6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.492212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.492212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.492212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.493394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.494249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.496734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468eb06-e61b-442b-a09d-420f0ae5598f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.507491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac0890-4104-49bc-b5e5-bee5c14acb38 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.512691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.513609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.513892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.514286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] PATH_INFO: `/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519/users/0d8ddc6b91004bfab9f53bb491d4f477/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.516841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ae9bb96c8448f2a33a685ac0eb4519, user_id=0d8ddc6b91004bfab9f53bb491d4f477, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.520890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.521752 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1104/2250] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:37:58.523422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.523717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.529729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.535920 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1147/2251] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:58 2022] PUT /identity/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519/users/0d8ddc6b91004bfab9f53bb491d4f477/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:58.537051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.540778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:58.559048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:58.562032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:58.638577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56507-f287-48c4-a868-041528089f2f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.645386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.646099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.646431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.646655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] PATH_INFO: `/v3/projects/874c669c1b1b40c49841ee9219d369a8` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.648596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=874c669c1b1b40c49841ee9219d369a8)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.652748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.670596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1105/2252] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:58.674764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.687019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1095f-ae0e-4164-93e8-c4047243261a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:58.692362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:58.693362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:58.693712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:58.694055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] PATH_INFO: `/v3/projects/e873bfb8bd534f6f986e37c983b71b65/users/847f4ec2137b47b2953c2a57e723b41c/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:58.710955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e873bfb8bd534f6f986e37c983b71b65, user_id=847f4ec2137b47b2953c2a57e723b41c, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:58.715043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:58.942798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1106/2253] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:37:58 2022] PUT /identity/v3/projects/e873bfb8bd534f6f986e37c983b71b65/users/847f4ec2137b47b2953c2a57e723b41c/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:58.943574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:58.967217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874c669c1b1b40c49841ee9219d369a8', 'request_id': 'req-4065b305-f5f3-481e-bb34-131fb197f0ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:58.975969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874c669c1b1b40c49841ee9219d369a8', 'request_id': 'req-4065b305-f5f3-481e-bb34-131fb197f0ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:59.053500 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b15a-7f30-445e-b02a-0d149c276787 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:59.117972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874c669c1b1b40c49841ee9219d369a8', 'request_id': 'req-4065b305-f5f3-481e-bb34-131fb197f0ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:59.130151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:59.131436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.131873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.132445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.133490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:37:59.133820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:59.136035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:59.137958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] The token cache is being invalidate because project 874c669c1b1b40c49841ee9219d369a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:37:59.138259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:59.140515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4065b305-f5f3-481e-bb34-131fb197f0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:37:59.143765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1148/2254] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:37:58 2022] DELETE /identity/v3/projects/874c669c1b1b40c49841ee9219d369a8 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:37:59.145481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.145961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.146957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.158184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1107/2255] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:37:59.161437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:59.163424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:59.214265 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6850-4d3d-4fe8-902a-710921a9cbe1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:59.231332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:59.231513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] MFA Rules not processed for user `847f4ec2137b47b2953c2a57e723b41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:37:59.231615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.231615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.231615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.231870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:59.231962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:59.244201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:59.352125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1149/2256] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:37:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:37:59.360690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:59.367249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:59.392873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e766c-a5ce-40d4-97fe-393d35b3658d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:59.393403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1108/2257] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:59 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:59.394361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:59.396259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:37:59.467042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:59.467846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.468133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.468415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] PATH_INFO: `/v3/users/6e4d507689e94a7fa40604fc934c4aaf` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.469675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4d507689e94a7fa40604fc934c4aaf)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:59.471634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:59.478480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cfdfb-8995-4bde-8a04-324d231d0c95 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:59.487929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:59.488649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.488984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.489263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.490834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:59.493132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:37:59.707306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1109/2258] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:59.707306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:37:59.788295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202dd-236c-4e40-a624-e24f2749633b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:37:59.795765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:37:59.797405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:37:59.797405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:37:59.797405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:37:59.797797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:37:59.799758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.154389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1110/2259] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:37:59 2022] POST /identity/v3/users => generated 289 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:00.154389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.165029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4d507689e94a7fa40604fc934c4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:00.166170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4d507689e94a7fa40604fc934c4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:00.166885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4d507689e94a7fa40604fc934c4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:00.168451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a946-adb6-494f-b831-aa56146b74bf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.182685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4d507689e94a7fa40604fc934c4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:00.186681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.187397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.188848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.189136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.190550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.198814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.206707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4d507689e94a7fa40604fc934c4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:00.364214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1111/2260] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:00 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:00.367436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.368552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:00.372348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1150/2261] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:37:59 2022] DELETE /identity/v3/users/6e4d507689e94a7fa40604fc934c4aaf => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:00.374049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.375841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:00.392469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7791-2ac8-4565-a563-ec5f347bd2eb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.466108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dca85-07e2-43a8-8323-2126ba111e20 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.467192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.467992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.468342 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.468723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.469533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.471292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae89ffb-24d2-40ab-a643-e38c5ccf8eab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.472347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.473400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.473820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.475268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.476457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.478280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.485360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1112/2262] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:00.486807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.487298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.487631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.490891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1151/2263] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:00.491862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.502871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c25f-1a61-46cb-ad67-eb999d29fd2c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.507981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.508667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.508947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.509219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.509940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.510473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:00.512605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.512753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:00.528608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1152/2264] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:00.528608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.533081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1113/2265] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:00.533991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.546046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a979-54f8-4e69-ad48-5d88a0f87a8b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.549563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4fbe2-bed2-47d3-9692-bc7b3910065b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.552284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.553168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.553547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.553832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] PATH_INFO: `/v3/projects/a6c145cef5494d4794a1fc08f56d6c21/users/1b264019b2ed4e17a45622421db14958/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.555211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.556027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.556382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.556867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.558159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.559997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.583324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c145cef5494d4794a1fc08f56d6c21, user_id=1b264019b2ed4e17a45622421db14958, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.584922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1153/2266] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:00.585817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.591073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:00.591425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf490bd4-1b48-4246-8ce4-37777e7e48d2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.674067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401fa3a-1297-49ba-b6df-5ac019d7691e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.679277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.680121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.680510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.681037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.692761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.694285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.705896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1154/2267] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:00.710148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:00.717687 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eca89-d69a-4b3a-9f31-8d783c0a8178 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:00.727097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:00.728116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.730175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.730331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] PATH_INFO: `/v3/projects/3b012d0c5120438cba1fb6bddc4d2ee5/users/a976da231cb04256bf0f816b1cb13439/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.750800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b012d0c5120438cba1fb6bddc4d2ee5, user_id=a976da231cb04256bf0f816b1cb13439, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:00.753581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789da56-1892-43b7-be7c-655c5728e6af admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:00.788138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1114/2268] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:00 2022] PUT /identity/v3/projects/a6c145cef5494d4794a1fc08f56d6c21/users/1b264019b2ed4e17a45622421db14958/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:00.799932 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.800253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.800705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.840446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] MFA Rules not processed for user `1b264019b2ed4e17a45622421db14958`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:00.842142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:00.888111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1155/2269] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:00 2022] PUT /identity/v3/projects/3b012d0c5120438cba1fb6bddc4d2ee5/users/a976da231cb04256bf0f816b1cb13439/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:00.893591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:00.894000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:00.894384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:00.943044 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] MFA Rules not processed for user `a976da231cb04256bf0f816b1cb13439`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:00.944514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:01.078534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1115/2270] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:01.090120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.095274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:01.188757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1156/2271] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:01.197310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.225878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93728-38d4-450d-864e-dba8c27dda2c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.264155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:01.328896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.329584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.329876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.330162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.344840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90af23-2602-4566-9a19-89fbc2a4ed93 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.351267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.351619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.352076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.352580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.353994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.357538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.425067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.426545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.437810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1116/2272] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:01.505587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1157/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:01 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:01.509935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.529575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642efd-2424-46c8-b726-cf55f78eb40c service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.610579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.611341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.611607 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.611895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.612664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.617808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.722197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.732245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1117/2274] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:01 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:01.757448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e617-b1c6-46b5-a1fe-d681c5c9187c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.771420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.772113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.772384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.772822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.773590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.775202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.797703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1158/2275] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:01.799226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.806822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:01.812094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d876e-d67f-40fd-a6f5-c37ee59ddd91 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.815181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:01.818770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.826750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.827339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.827828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] PATH_INFO: `/v3/projects/f9c8877dc96e4761944b3a59784d81a0/users/091dd18f45e243c6ae659de1a2dae85f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.849374 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6a69-abc8-4067-b667-bfc8e308b296 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:01.849584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c8877dc96e4761944b3a59784d81a0, user_id=091dd18f45e243c6ae659de1a2dae85f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.849584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.859005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:01.860373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:01.860691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:01.860974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] PATH_INFO: `/v3/projects/309adfa37c76490f97b5758273bd62a7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:01.862301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309adfa37c76490f97b5758273bd62a7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:01.866145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:01.869667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:01.947405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1118/2276] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:01 2022] PUT /identity/v3/projects/f9c8877dc96e4761944b3a59784d81a0/users/091dd18f45e243c6ae659de1a2dae85f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:01.954000 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:02.017073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c09cf-2b39-4bba-abc4-b75eb6a84ff7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:02.021887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:02.022945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:02.023228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:02.023507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:02.024246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:02.025892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:02.039900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1119/2277] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:02.041370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:02.055372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1dc4a-bd25-4f15-b718-930996a168d0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:02.076711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309adfa37c76490f97b5758273bd62a7', 'request_id': 'req-1cabde65-80c5-4a35-b5b6-9c27967884b6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.091427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309adfa37c76490f97b5758273bd62a7', 'request_id': 'req-1cabde65-80c5-4a35-b5b6-9c27967884b6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.182396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:02.185742 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:02.187131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:02.187519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] PATH_INFO: `/v3/projects/f9c8877dc96e4761944b3a59784d81a0/users/091dd18f45e243c6ae659de1a2dae85f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:02.192872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c8877dc96e4761944b3a59784d81a0, user_id=091dd18f45e243c6ae659de1a2dae85f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:02.197991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df56b6-ddca-45e6-bd37-a875338d96c1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:02.241957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1120/2278] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:02 2022] PUT /identity/v3/projects/f9c8877dc96e4761944b3a59784d81a0/users/091dd18f45e243c6ae659de1a2dae85f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:02.243885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:02.245791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:02.246090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:02.294107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309adfa37c76490f97b5758273bd62a7', 'request_id': 'req-1cabde65-80c5-4a35-b5b6-9c27967884b6'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.296012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] MFA Rules not processed for user `091dd18f45e243c6ae659de1a2dae85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:02.297649 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:02.307930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] The token cache is being invalidate because project 309adfa37c76490f97b5758273bd62a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:02.308345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.310608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.317387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1159/2279] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:01 2022] DELETE /identity/v3/projects/309adfa37c76490f97b5758273bd62a7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:02.320959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:02.325303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:02.348284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabde65-80c5-4a35-b5b6-9c27967884b6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:02.440695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1121/2280] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:02.451017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:02.459641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:02.490500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:02.491902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:02.492188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:02.492790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] PATH_INFO: `/v3/users/3fa66e45a7a04a59a3d420d62d82bd4e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:02.494407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa66e45a7a04a59a3d420d62d82bd4e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:02.497326 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:02.554088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaae44-ce0f-4cda-a3ec-0ed1b74443ca None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:02.559802 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:02.560332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:02.560662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:02.560941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:02.581946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:02.583561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:02.595579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1122/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:02.919334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa66e45a7a04a59a3d420d62d82bd4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.920311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa66e45a7a04a59a3d420d62d82bd4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.921045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa66e45a7a04a59a3d420d62d82bd4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.948275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa66e45a7a04a59a3d420d62d82bd4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:02.961090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa66e45a7a04a59a3d420d62d82bd4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:03.136738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1160/2282] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:02 2022] DELETE /identity/v3/users/3fa66e45a7a04a59a3d420d62d82bd4e => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:03.997474 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:04.013623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633797a-c682-4278-9151-9d3f1d00c0b9 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:04.104782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:04.107480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.107949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.108326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] PATH_INFO: `/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.109899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca41ad3e32b456da5ee0b693ae485c4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:04.112383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:04.171385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:04.341230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca41ad3e32b456da5ee0b693ae485c4', 'request_id': 'req-e10c2131-2543-4959-af1a-b4b0c14836e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:04.373523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca41ad3e32b456da5ee0b693ae485c4', 'request_id': 'req-e10c2131-2543-4959-af1a-b4b0c14836e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:04.392249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca41ad3e32b456da5ee0b693ae485c4', 'request_id': 'req-e10c2131-2543-4959-af1a-b4b0c14836e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:04.486581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:04.488869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:04.496204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] The token cache is being invalidate because project 5ca41ad3e32b456da5ee0b693ae485c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:04.496204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:04.496204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e10c2131-2543-4959-af1a-b4b0c14836e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:04.496848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1123/2283] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:03 2022] DELETE /identity/v3/projects/5ca41ad3e32b456da5ee0b693ae485c4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:04.500968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528bac-58c5-482e-b36b-27326ddc85ea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.501461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528bac-58c5-482e-b36b-27326ddc85ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.501790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528bac-58c5-482e-b36b-27326ddc85ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.543369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-17528bac-58c5-482e-b36b-27326ddc85ea None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:04.543369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-17528bac-58c5-482e-b36b-27326ddc85ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:04.570007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acb15-604e-4bb3-a72d-6fa9b1793b8b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:04.643956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:04.644832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.645211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.645623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.648539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:04.667280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1124/2284] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:04.676328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.676694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.677175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.705810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:04.708205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:04.727204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1125/2285] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:04.728888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:04.735018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:04.737776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:04.740180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068940e-49c3-4ad0-8d44-43b2bc7dbbbc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:04.747141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:04.747913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.748459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.748844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.750436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:04.751077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:04.756272 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:04.765821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1161/2286] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:04.771132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1126/2287] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:38:04.775339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:04.795336 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a2a7-5ce5-4820-9ea5-780d2d4dc667 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:04.802848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:04.803807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:04.804156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:04.804517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:04.805579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:04.807684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:04.974503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1162/2288] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:04 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:04.978824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:04.992827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa40-0b49-419f-8675-038a5023682e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:05.083391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:05.084096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:05.084384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:05.084701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:05.085507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:05.087611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:05.299726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1127/2289] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:04 2022] POST /identity/v3/users => generated 282 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:05.303728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:05.316784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770be5f-b02c-4627-aae4-cd3c8bb80fcc admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:05.322672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:05.323354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:05.323636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:05.324809 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:05.325974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:05.328176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:05.344881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1163/2290] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:05.349666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:05.361476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98457-cab6-463b-b874-38b2af6b5c87 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:05.370334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:05.371303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:05.371640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:05.371922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:05.372936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:05.374936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ac59e-8ba2-4fa3-b12a-3b080e749511 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:05.387257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1128/2291] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:05.395679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:05.428254 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0ded6-5704-44b0-aa2b-829852512230 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:05.442742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:05.443639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:05.444795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:05.445154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] PATH_INFO: `/v3/projects/2387987f8fc94beaa377dbd22dd17ef5/users/61509833257f49638cc58a7f11038c34/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:05.486013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2387987f8fc94beaa377dbd22dd17ef5, user_id=61509833257f49638cc58a7f11038c34, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:05.490033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:05.687390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1164/2292] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:05 2022] PUT /identity/v3/projects/2387987f8fc94beaa377dbd22dd17ef5/users/61509833257f49638cc58a7f11038c34/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:05.698359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:05.702302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:05.702302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:05.739012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] MFA Rules not processed for user `61509833257f49638cc58a7f11038c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:05.740179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:05.761100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:05.891511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1129/2293] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:05.895588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.023726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91592e6-0a97-45e6-b22e-8bf51c783e3a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.034635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.035373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.035655 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.035957 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.043151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.049267 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.190734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1165/2294] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:05 2022] POST /identity/v3/projects => generated 363 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:06.192080 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.214460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea30d0-383d-4bad-898e-4e197585045f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.298333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.299115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.299402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.299849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.300587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.302787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.356781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:06.418838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1130/2295] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:06 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:06.422958 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.439750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f0d1-bf94-4fa8-90a0-d20e5f29c826 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.440220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.440973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.441284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.441563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.442309 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.444090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.458162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1166/2296] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:06.462568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.475251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9406af-9411-4c6f-8ee0-06d00888a023 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.481940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.482861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.483141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.483423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] PATH_INFO: `/v3/projects/a8eec7f7582d47d3948802d863639388/users/2114ba29b67e4eb99b87b7bfc3e673da/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.502756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eec7f7582d47d3948802d863639388, user_id=2114ba29b67e4eb99b87b7bfc3e673da, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.505872 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.651266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1131/2297] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:06 2022] PUT /identity/v3/projects/a8eec7f7582d47d3948802d863639388/users/2114ba29b67e4eb99b87b7bfc3e673da/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:06.656470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.670962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4f56-1e2b-40c5-a6bd-e7d9ac00a825 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.774592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.775237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.775516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.775788 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.776656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.779016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a0143-5ff0-4188-80e5-6e4c7758919e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.796643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1167/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:06.803623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:06.830231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20b234-38a0-4697-91f2-0900f3c1871c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:06.849929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:06.851012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.852632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.853195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] PATH_INFO: `/v3/projects/a8eec7f7582d47d3948802d863639388/users/2114ba29b67e4eb99b87b7bfc3e673da/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.862827 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eec7f7582d47d3948802d863639388, user_id=2114ba29b67e4eb99b87b7bfc3e673da, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:06.866655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:06.888347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1132/2299] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:06 2022] PUT /identity/v3/projects/a8eec7f7582d47d3948802d863639388/users/2114ba29b67e4eb99b87b7bfc3e673da/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:06.908004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0fd0-a9f5-40cb-a47a-bfcc7a55a46a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:06.909826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0fd0-a9f5-40cb-a47a-bfcc7a55a46a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:06.910652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0fd0-a9f5-40cb-a47a-bfcc7a55a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:06.942805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-313d0fd0-a9f5-40cb-a47a-bfcc7a55a46a None None] MFA Rules not processed for user `2114ba29b67e4eb99b87b7bfc3e673da`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:06.944146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-313d0fd0-a9f5-40cb-a47a-bfcc7a55a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.086728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1168/2300] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:07.099018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:07.102816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.120311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:07.120639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:07.121085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:07.149205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] MFA Rules not processed for user `0d8ddc6b91004bfab9f53bb491d4f477`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:07.150468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.177616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3876a1-9e41-44f5-893a-fd7de1d8bcf5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:07.181978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:07.182635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:07.182912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:07.183182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:07.199800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:07.202085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:07.213583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1133/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:07.243075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1169/2302] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:07.258750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:07.260095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.342320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a4bd6-d6ad-4286-b07c-390d33600fe3 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:07.347828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:07.348555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:07.348793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:07.349083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:07.350870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.419514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:07.421284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:07.430771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1134/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:07.533757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:07.535769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:07.549663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed848-e564-402f-855c-fc183478d5e4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:07.554143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:07.554805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:07.555143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:07.555473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:07.622891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:07.624338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd524828-33eb-42f3-839b-719a46b55e97 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:07.633861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1170/2304] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:09.072143 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:10.244330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:11.978609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:13.638349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:13.647941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c0c3-f2f4-45bc-bfd4-025348f8f177 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:13.651851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:13.652611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:13.652963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:13.653311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:13.656160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:13.725234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:13.726608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:13.735808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1135/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:15.013944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:15.907556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c6eb7-c1c5-4642-9039-a1f8e8ad841e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:15.908146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c6eb7-c1c5-4642-9039-a1f8e8ad841e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:15.908146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c6eb7-c1c5-4642-9039-a1f8e8ad841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:15.927392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b83c6eb7-c1c5-4642-9039-a1f8e8ad841e None None] MFA Rules not processed for user `fb1df28c175c40b7a06d1f94ba780d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:15.928643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b83c6eb7-c1c5-4642-9039-a1f8e8ad841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:15.986166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1171/2306] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:16.202349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:16.417317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:16.762302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:16.876724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:17.156621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:17.299586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:17.608864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.063548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.196811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.431193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.613800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.642362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:18.966625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.023740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.213964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.242565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.328639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.474975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.591103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.613956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.715006 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.745791 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.951725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.974430 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.161160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.225711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.362852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.391259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.534234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.557236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.626056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.694246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.774284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:20.923287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.014483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.098323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.183870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.269663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.298215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.409026 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.509217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.543745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.664104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.900139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:21.967229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:22.111468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:22.401561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:22.689100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:22.750945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:22.921080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:26.724362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:26.725859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:26.791849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ba8fa-9100-461c-aea5-6272d5e72b31 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:26.796452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:26.797467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:26.797754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:26.798028 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] PATH_INFO: `/v3/users/847f4ec2137b47b2953c2a57e723b41c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:26.799216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847f4ec2137b47b2953c2a57e723b41c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:26.801220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:26.827115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:27.029302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847f4ec2137b47b2953c2a57e723b41c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:27.029884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847f4ec2137b47b2953c2a57e723b41c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:27.030491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847f4ec2137b47b2953c2a57e723b41c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:27.043584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847f4ec2137b47b2953c2a57e723b41c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:27.051071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847f4ec2137b47b2953c2a57e723b41c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:27.131196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1136/2307] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:26 2022] DELETE /identity/v3/users/847f4ec2137b47b2953c2a57e723b41c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:27.136039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:27.136545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:27.136661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:27.154423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:27.155626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:27.201080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:27.219010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1172/2308] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:27.229269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:27.230817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:27.300266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153eb3-f98d-417c-9bbe-f740c796ca15 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:27.304519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:27.305186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:27.305464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:27.305735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:27.315845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:27.317443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:27.327506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1137/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:27.973845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:27.975297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:27.988328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a01a6-8121-4a22-a8b0-5413e76141b2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:27.993266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:27.994263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:27.994544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:27.994865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] PATH_INFO: `/v3/projects/e873bfb8bd534f6f986e37c983b71b65` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:27.996062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e873bfb8bd534f6f986e37c983b71b65)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:27.998359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:28.144110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e873bfb8bd534f6f986e37c983b71b65', 'request_id': 'req-4e3f7720-f944-4c2c-9477-98541d4b9448'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.150747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e873bfb8bd534f6f986e37c983b71b65', 'request_id': 'req-4e3f7720-f944-4c2c-9477-98541d4b9448'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.244214 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e873bfb8bd534f6f986e37c983b71b65', 'request_id': 'req-4e3f7720-f944-4c2c-9477-98541d4b9448'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.257104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] The token cache is being invalidate because project e873bfb8bd534f6f986e37c983b71b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:28.257370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.258014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.259561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1173/2310] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:27 2022] DELETE /identity/v3/projects/e873bfb8bd534f6f986e37c983b71b65 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:28.263637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:28.274079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea0e2-727e-4a6d-a281-7230df4b65ca service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:28.343075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:28.344007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:28.344813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:28.345187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] PATH_INFO: `/v3/users/a976da231cb04256bf0f816b1cb13439` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:28.346392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a976da231cb04256bf0f816b1cb13439)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:28.348330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:28.612973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:28.615682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a976da231cb04256bf0f816b1cb13439'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.616365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a976da231cb04256bf0f816b1cb13439'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.617440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a976da231cb04256bf0f816b1cb13439'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.629919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a976da231cb04256bf0f816b1cb13439'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.636866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a976da231cb04256bf0f816b1cb13439'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:28.719974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1138/2311] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:28 2022] DELETE /identity/v3/users/a976da231cb04256bf0f816b1cb13439 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:29.211608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:29.211608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:29.235219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7720-f944-4c2c-9477-98541d4b9448 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:29.322720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:29.323675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:29.323964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:29.324239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] PATH_INFO: `/v3/projects/3b012d0c5120438cba1fb6bddc4d2ee5` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:29.325474 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b012d0c5120438cba1fb6bddc4d2ee5)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:29.329460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:29.350433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:29.352141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:29.367901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146c71-67d8-4ff4-882f-9c52d2f66bb6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:29.373445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:29.374424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:29.374781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:29.375207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] PATH_INFO: `/v3/users/61509833257f49638cc58a7f11038c34` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:29.377155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61509833257f49638cc58a7f11038c34)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:29.379102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:29.512095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b012d0c5120438cba1fb6bddc4d2ee5', 'request_id': 'req-2897c1ab-c676-4073-bc44-b9527a55775b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.518475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b012d0c5120438cba1fb6bddc4d2ee5', 'request_id': 'req-2897c1ab-c676-4073-bc44-b9527a55775b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.673115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b012d0c5120438cba1fb6bddc4d2ee5', 'request_id': 'req-2897c1ab-c676-4073-bc44-b9527a55775b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.685861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:29.689947 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61509833257f49638cc58a7f11038c34'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.690441 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] The token cache is being invalidate because project 3b012d0c5120438cba1fb6bddc4d2ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:29.690735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.691105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61509833257f49638cc58a7f11038c34'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.691549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.691732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61509833257f49638cc58a7f11038c34'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.693353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1174/2312] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:29 2022] DELETE /identity/v3/projects/3b012d0c5120438cba1fb6bddc4d2ee5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:29.697397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:29.699136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:29.713186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61509833257f49638cc58a7f11038c34'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.721071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6d96e99-0d4a-40a0-81eb-a765ed81f13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61509833257f49638cc58a7f11038c34'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:29.778488 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897c1ab-c676-4073-bc44-b9527a55775b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:29.784066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:29.785480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:29.789061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:29.792099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] PATH_INFO: `/v3/users/091dd18f45e243c6ae659de1a2dae85f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:29.797170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091dd18f45e243c6ae659de1a2dae85f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:29.800122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:29.819301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1139/2313] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:29 2022] DELETE /identity/v3/users/61509833257f49638cc58a7f11038c34 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:29.823859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:29.824366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:29.824861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:29.842392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:29.847169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:29.905624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1140/2314] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:29.916795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:29.918326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:29.953387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:29.975009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe6389-c0cc-4bd4-98f1-0f36d50c79cd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:29.979216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:29.980131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:29.980546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:29.980930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:29.992127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:29.993612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:30.003574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1141/2315] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:30.070276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091dd18f45e243c6ae659de1a2dae85f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.070276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091dd18f45e243c6ae659de1a2dae85f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.070276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091dd18f45e243c6ae659de1a2dae85f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.092211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091dd18f45e243c6ae659de1a2dae85f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.102095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091dd18f45e243c6ae659de1a2dae85f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.211288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1175/2316] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:29 2022] DELETE /identity/v3/users/091dd18f45e243c6ae659de1a2dae85f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:30.571390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:30.573025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:30.594343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a14b6d-4ee9-4f0c-a275-4fc2ff0e65a2 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:30.695363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:30.696425 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:30.698271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:30.698271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] PATH_INFO: `/v3/projects/2387987f8fc94beaa377dbd22dd17ef5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:30.699317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2387987f8fc94beaa377dbd22dd17ef5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:30.701419 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:30.851877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2387987f8fc94beaa377dbd22dd17ef5', 'request_id': 'req-adeb7042-934e-4e5b-b71f-a1520fcf4747'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.860136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2387987f8fc94beaa377dbd22dd17ef5', 'request_id': 'req-adeb7042-934e-4e5b-b71f-a1520fcf4747'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.868837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2387987f8fc94beaa377dbd22dd17ef5', 'request_id': 'req-adeb7042-934e-4e5b-b71f-a1520fcf4747'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.940201 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] The token cache is being invalidate because project 2387987f8fc94beaa377dbd22dd17ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:30.940531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.941197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:30.945842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1142/2317] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:30 2022] DELETE /identity/v3/projects/2387987f8fc94beaa377dbd22dd17ef5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:30.946865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:30.948523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:30.962883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cf4c-e96c-4645-af6e-7f933bd36226 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:31.042048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:31.043081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.043373 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.043724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] PATH_INFO: `/v3/users/2114ba29b67e4eb99b87b7bfc3e673da` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.045036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2114ba29b67e4eb99b87b7bfc3e673da)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:31.046997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:31.072531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:31.115189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:31.116868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:31.134093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7042-934e-4e5b-b71f-a1520fcf4747 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:31.139684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:31.141766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.142088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.142412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] PATH_INFO: `/v3/projects/f9c8877dc96e4761944b3a59784d81a0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.144178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c8877dc96e4761944b3a59784d81a0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:31.146728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:31.301896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2114ba29b67e4eb99b87b7bfc3e673da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.302526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2114ba29b67e4eb99b87b7bfc3e673da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.303397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2114ba29b67e4eb99b87b7bfc3e673da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.304296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c8877dc96e4761944b3a59784d81a0', 'request_id': 'req-562c7109-7f18-4713-87cc-013df5579b2f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.312082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c8877dc96e4761944b3a59784d81a0', 'request_id': 'req-562c7109-7f18-4713-87cc-013df5579b2f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.316979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2114ba29b67e4eb99b87b7bfc3e673da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.320930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:31.322651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c8877dc96e4761944b3a59784d81a0', 'request_id': 'req-562c7109-7f18-4713-87cc-013df5579b2f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.324168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-617b481e-2f39-4bbd-aca3-6c904b66dceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2114ba29b67e4eb99b87b7bfc3e673da'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.449573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] The token cache is being invalidate because project f9c8877dc96e4761944b3a59784d81a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:31.449893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.451816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-562c7109-7f18-4713-87cc-013df5579b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:31.452176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1143/2318] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:31 2022] DELETE /identity/v3/projects/f9c8877dc96e4761944b3a59784d81a0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:31.458412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.458704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.458985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.489864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:31.492122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:31.537812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1176/2319] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:30 2022] DELETE /identity/v3/users/2114ba29b67e4eb99b87b7bfc3e673da => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:31.585151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1144/2320] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:31.588019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.588019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.588019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.608125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:31.609410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:31.674642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1177/2321] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:31.679085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:31.691346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0155ac-a34d-48e3-aa1b-ddf85374d968 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:31.697244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:31.698668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.699173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.699694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.700654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:31.701154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:31.703311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:31.719871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1145/2322] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:38:31.725401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:31.737756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f416fa-146f-4817-a4bf-a54c3c5828ac None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:31.742690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:31.743589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.744383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.744803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.755681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:31.760402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:31.879999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1178/2323] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:31.883961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:31.906291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3ec2-b5c9-437a-bb5b-462d4505a74a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:31.992454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:31.993176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:31.993469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:31.993754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:31.994459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:31.996414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.115172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1146/2324] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:31 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:32.116913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.130484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d803ab-09e6-4e34-9a98-5805c9c465e4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.137094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.138125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.138540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.138890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.139695 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.141428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.154666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1179/2325] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:32.158956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.174539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6dc4-0c10-4ee3-8e49-8fb698992c3e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.188901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.188901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.188901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.188901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.189222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.189222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.202758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1147/2326] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:32.207171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.218629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08413-29fe-4bc6-8222-4ad473d4c881 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.226000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.229130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.229130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.229130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] PATH_INFO: `/v3/projects/b835d5c2aafa4eedbeec38ab13edcead/users/93084ae9afa643c8967184e30e984f5d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.248268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b835d5c2aafa4eedbeec38ab13edcead, user_id=93084ae9afa643c8967184e30e984f5d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.250999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cc4ff-9eca-4579-aeac-559cfd140a7b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.365809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.368451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:32.380963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1180/2327] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:32 2022] PUT /identity/v3/projects/b835d5c2aafa4eedbeec38ab13edcead/users/93084ae9afa643c8967184e30e984f5d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:32.384753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.385042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.385680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.397787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64e5e-24ca-42ad-84f6-ec5818a18d42 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.427593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] MFA Rules not processed for user `93084ae9afa643c8967184e30e984f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:32.428885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:32.469365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:32.472053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:32.479471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.480417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.480734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.481014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] PATH_INFO: `/v3/projects/a8eec7f7582d47d3948802d863639388` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.482226 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8eec7f7582d47d3948802d863639388)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.484152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.506419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1181/2328] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:32.510808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.521915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d750edd-2f7b-4cc0-91c0-aca560df63a3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.526887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.527557 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.527843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.528206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.528949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.530860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.606357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8eec7f7582d47d3948802d863639388', 'request_id': 'req-6877f701-ac24-4f49-beda-44d7abd12987'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:32.614740 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8eec7f7582d47d3948802d863639388', 'request_id': 'req-6877f701-ac24-4f49-beda-44d7abd12987'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:32.627973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8eec7f7582d47d3948802d863639388', 'request_id': 'req-6877f701-ac24-4f49-beda-44d7abd12987'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:32.683670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1182/2329] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:32.684680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.734906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] The token cache is being invalidate because project a8eec7f7582d47d3948802d863639388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:32.735306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:32.737590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6877f701-ac24-4f49-beda-44d7abd12987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:32.742661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1148/2330] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:32 2022] DELETE /identity/v3/projects/a8eec7f7582d47d3948802d863639388 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:32.744710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc8e4-3b25-484e-92d4-593dae30a365 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.745003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc8e4-3b25-484e-92d4-593dae30a365 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.745279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc8e4-3b25-484e-92d4-593dae30a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.803283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-571bc8e4-3b25-484e-92d4-593dae30a365 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:32.806456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-571bc8e4-3b25-484e-92d4-593dae30a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:32.817766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1149/2331] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:32.827182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d102e7-37b6-4810-8449-5b126eec7819 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.829383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.829383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.829383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.841082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.841769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.842047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.842320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.843020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.845271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.864348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:32.865848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:32.881010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1150/2332] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:32.881708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.894839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a5356-b2c6-4853-8bb2-460b779eb384 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.901921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.901921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.902151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.902316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.907510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:32.907510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.907510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.924659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1151/2333] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:38:32.926156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.936297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa239559-8d35-445b-adad-92b17d7c26e0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.942086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:32.942820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:32.943176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:32.943529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:32.944328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:32.946413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:32.974313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1183/2334] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:32.975894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:32.977076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:32.990897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120dce-fcb8-47cb-bed1-94fe61b03981 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:32.999649 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.000343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.007171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.007171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.007171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.007171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.018741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1184/2335] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:33.022726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.050975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87cebe-8f02-4060-b831-ef84ba97bdc1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.050975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.051706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.051984 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.052259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] PATH_INFO: `/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b/users/41ea13708a5c48c78158df0690772a1b/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.080613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a5c0b8f4bf40678ca695e9c033188b, user_id=41ea13708a5c48c78158df0690772a1b, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.084546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.099939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1152/2336] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:32 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:33.104924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.190407 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899238d-1fbc-454f-9fb9-a704ceab7e89 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.198130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.198792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.199097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.199420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.200193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.202348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.227238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1185/2337] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:33 2022] PUT /identity/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b/users/41ea13708a5c48c78158df0690772a1b/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:33.230906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.299063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce803-6e63-44fb-b038-f7d4a03a6d68 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.304232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.304967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.305217 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.305489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.306317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.307934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.311894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1153/2338] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:33 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:33.312669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.320378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1186/2339] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:33.323464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f357-5de5-4744-87fc-795c292b40db admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.325752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.329587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.331070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.331423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.331766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.332639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.334375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.343500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1092-f2d6-4bbd-b688-db6bd9187f29 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.348973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.349888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.350173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.350451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] PATH_INFO: `/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b/users/41ea13708a5c48c78158df0690772a1b/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.351975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1154/2340] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:33.352709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a5c0b8f4bf40678ca695e9c033188b, user_id=41ea13708a5c48c78158df0690772a1b, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.355850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b407e-e7e1-4dfe-a2b0-96c1eaa6fca8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.356574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.367239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae41814-579d-4d83-9687-2e3fd9fd3620 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.371516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1187/2341] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:33 2022] PUT /identity/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b/users/41ea13708a5c48c78158df0690772a1b/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:33.381857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.382147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.382437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.415540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] MFA Rules not processed for user `41ea13708a5c48c78158df0690772a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:33.416789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:33.436022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.436753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.437015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.437286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.438021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.440171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.451040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1155/2342] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:33.455025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.465175 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1f32-a87c-4ee1-bba6-4aeb17e88d43 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.470085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.472247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.472247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.472508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] PATH_INFO: `/v3/projects/7bc333a361e24bd6b4142f1a03ba0878/users/5c14cff9dd4247daac1400ec3610e68a/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.492717 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc333a361e24bd6b4142f1a03ba0878, user_id=5c14cff9dd4247daac1400ec3610e68a, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.495589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168c71a-68be-408d-a02c-c580c52f9c20 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.502434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1188/2343] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:33.513982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.515337 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:33.574993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1156/2344] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:33 2022] PUT /identity/v3/projects/7bc333a361e24bd6b4142f1a03ba0878/users/5c14cff9dd4247daac1400ec3610e68a/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:33.585836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.586198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:33.586368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.586648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.600627 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5947fa-d3f6-4035-b808-5b51873b4e0d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.623437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] MFA Rules not processed for user `5c14cff9dd4247daac1400ec3610e68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:33.625335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:33.646153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:33.668155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.668983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.669410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.669703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.704355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1157/2345] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:33.709610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.741087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.742524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.754134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1189/2346] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:33.778116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ecff4-fd36-4b7d-8dcd-2d97db084f3f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.787831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.789904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.789904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.789904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.790315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:33.792636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:33.917410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.927967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30270fa-5685-4f3d-ae88-fb91c31e5bb8 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:33.932991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1158/2347] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:33 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:33.933574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:33.934230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:33.934542 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:33.934830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:33.936956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:33.937244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:34.008681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:34.010878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.012320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.014974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491124b9-f1ee-4167-8ed0-a9b6c1ed311b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.021194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.021770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.022125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.022462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.023074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1190/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:34.025059 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.028711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.176262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1159/2349] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:33 2022] POST /identity/v3/users => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:34.180393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.196962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad810128-bf9e-4b21-b7fb-fd2ebbf008f8 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.202163 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.202839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.203178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.204045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.204866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.207446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.218546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1191/2350] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:34.226712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.238166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030778ac-66d8-4f92-a7f7-7bb11d6ca90a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.247727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.248671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.249217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.249978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] PATH_INFO: `/v3/projects/09312610278d480f82fccab32e393e05/users/e83814156636426a82b44479d243edcc/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.268922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09312610278d480f82fccab32e393e05, user_id=e83814156636426a82b44479d243edcc, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.271616 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.348610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1160/2351] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:34 2022] PUT /identity/v3/projects/09312610278d480f82fccab32e393e05/users/e83814156636426a82b44479d243edcc/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:34.352758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.364235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eade2-fb54-4f55-a94b-968908e0e560 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.423552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.424817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.425100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.425523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.426221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.427897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639cefa-7bfc-4635-a966-11059f6d4e05 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.440913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1192/2352] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:34.445246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.455844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7e75-a590-44da-ae0f-9b54dd8d4bb2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.460937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.461825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.462106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.462382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] PATH_INFO: `/v3/projects/09312610278d480f82fccab32e393e05/users/e83814156636426a82b44479d243edcc/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.464340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09312610278d480f82fccab32e393e05, user_id=e83814156636426a82b44479d243edcc, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.467106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.471748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:34.480755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1161/2353] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:34 2022] PUT /identity/v3/projects/09312610278d480f82fccab32e393e05/users/e83814156636426a82b44479d243edcc/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:34.494578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.494578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.494578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.521313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] MFA Rules not processed for user `e83814156636426a82b44479d243edcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:34.522451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:34.589902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1193/2354] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:34.601321 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.603594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:34.618546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.624715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:34.668652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5e7-13c6-4327-9c14-df294ed9ca03 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.673428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.674787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.675170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.675513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.685455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429533ee-fd67-407d-b051-ef6e7af760db None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.687700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.689276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.691713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.694494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.694494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.694494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] PATH_INFO: `/v3/users/93084ae9afa643c8967184e30e984f5d` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.694494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93084ae9afa643c8967184e30e984f5d)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.696856 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.703934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1162/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:34.755115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:34.766843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9452c-93b5-4a09-b7ad-4bec689a094c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:34.770832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:34.771522 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:34.771762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:34.772039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:34.829409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:34.830965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d48c0-c355-4c2e-88df-aed56bc160a9 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:34.840003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1163/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:34.929915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93084ae9afa643c8967184e30e984f5d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:34.930560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93084ae9afa643c8967184e30e984f5d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:34.931239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93084ae9afa643c8967184e30e984f5d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:34.944881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93084ae9afa643c8967184e30e984f5d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:34.952209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93084ae9afa643c8967184e30e984f5d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:35.061897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1194/2357] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:34 2022] DELETE /identity/v3/users/93084ae9afa643c8967184e30e984f5d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:35.066379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:35.066672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:35.066953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:35.085152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:35.088180 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:35.089681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:35.151527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1164/2358] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:35.161948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:35.163358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:35.220156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:35.226611 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4252735-0dd7-4635-981c-aea92b16a84f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:35.230346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:35.230995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:35.231276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:35.231550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:35.241086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:35.242540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:35.252297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1195/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:35.855857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:35.858713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:35.870495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87635b7-d38a-4aa4-a085-2704a46dc893 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:35.875546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:35.876409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:35.876731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:35.877008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] PATH_INFO: `/v3/projects/b835d5c2aafa4eedbeec38ab13edcead` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:35.878962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b835d5c2aafa4eedbeec38ab13edcead)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:35.880961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:36.012258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b835d5c2aafa4eedbeec38ab13edcead', 'request_id': 'req-25bad05b-9dd1-464a-9340-961c10fa5435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.019257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b835d5c2aafa4eedbeec38ab13edcead', 'request_id': 'req-25bad05b-9dd1-464a-9340-961c10fa5435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.024977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b835d5c2aafa4eedbeec38ab13edcead', 'request_id': 'req-25bad05b-9dd1-464a-9340-961c10fa5435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.124962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] The token cache is being invalidate because project b835d5c2aafa4eedbeec38ab13edcead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:36.125205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.125870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.128137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1165/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:35 2022] DELETE /identity/v3/projects/b835d5c2aafa4eedbeec38ab13edcead => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:36.132001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:36.141884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b697d7-2c0e-487e-a6c4-7681e2c442ed service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:36.201226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:36.202109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:36.202386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:36.202657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] PATH_INFO: `/v3/users/41ea13708a5c48c78158df0690772a1b` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:36.203851 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ea13708a5c48c78158df0690772a1b)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:36.205871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:36.407231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ea13708a5c48c78158df0690772a1b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.407808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ea13708a5c48c78158df0690772a1b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.408421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ea13708a5c48c78158df0690772a1b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.420912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ea13708a5c48c78158df0690772a1b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.428400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e848de94-ba68-441a-8ef0-96a0b9f610ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ea13708a5c48c78158df0690772a1b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:36.503012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1196/2361] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:36 2022] DELETE /identity/v3/users/41ea13708a5c48c78158df0690772a1b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:36.972429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:36.973999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:36.987178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad05b-9dd1-464a-9340-961c10fa5435 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.047506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.048371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.048689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.048967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] PATH_INFO: `/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.050148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a5c0b8f4bf40678ca695e9c033188b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.052090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.074512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:37.158869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a5c0b8f4bf40678ca695e9c033188b', 'request_id': 'req-89a7f41b-80ee-40fb-9ea0-a3be00b14575'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:37.164907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a5c0b8f4bf40678ca695e9c033188b', 'request_id': 'req-89a7f41b-80ee-40fb-9ea0-a3be00b14575'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:37.170838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a5c0b8f4bf40678ca695e9c033188b', 'request_id': 'req-89a7f41b-80ee-40fb-9ea0-a3be00b14575'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:37.238636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] The token cache is being invalidate because project a6a5c0b8f4bf40678ca695e9c033188b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:37.238878 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:37.239521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-89a7f41b-80ee-40fb-9ea0-a3be00b14575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:37.241131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1166/2362] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:36 2022] DELETE /identity/v3/projects/a6a5c0b8f4bf40678ca695e9c033188b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:37.246201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.246668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.246760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.265709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:37.270580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:37.328211 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1197/2363] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:37.337927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.338215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.338489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.358404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:37.359744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:37.368980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1167/2364] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:37.373426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.383822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b1cf2-53d2-428f-83b0-e8353455a796 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.388582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.389241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.389523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.389800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.390522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:37.390835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.392476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.394918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:37.404328 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1198/2365] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:37.409341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.418701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cee1a-047e-42bf-a548-f8453f16ad4d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.423415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.429466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.429466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.429466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.429466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.429466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.516601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1168/2366] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:37 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:38:37.518945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.528893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe19a0-9827-4687-82ae-c78744a1de03 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.585109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.585774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.586061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.586340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.587061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.589028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.663105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1199/2367] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:37 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:37.667235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.679415 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc692bd-9258-4b05-8228-4013555c5c05 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.684043 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.684758 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.685038 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.685306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.686032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.687635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.702304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1169/2368] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:37.706892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.718161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43979f-ec14-4926-bbbf-357f3e637ec1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.726285 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.726971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.727380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.728736 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.729201 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.731104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1d408-42d0-4522-a333-ca9e0212f051 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.744661 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1200/2369] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:37.747531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.759176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de884e-586a-4bb3-bfb7-a026c44c93eb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:37.764831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:37.765723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.766007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.766276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] PATH_INFO: `/v3/projects/7ab3cd94a36a49ee9ba46dbac4df4b86/users/bbf0f583f8514d268339a72506d88960/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.783187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab3cd94a36a49ee9ba46dbac4df4b86, user_id=bbf0f583f8514d268339a72506d88960, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:37.787035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:37.857439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1170/2370] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:37 2022] PUT /identity/v3/projects/7ab3cd94a36a49ee9ba46dbac4df4b86/users/bbf0f583f8514d268339a72506d88960/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:37.868480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:37.868824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:37.869110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:37.895544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] MFA Rules not processed for user `bbf0f583f8514d268339a72506d88960`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:37.896817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:37.961800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1201/2371] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:37.973471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:37.975219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:38.031504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9815a5-2afa-442b-9290-5bf924b6777c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:38.035735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:38.036380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:38.036701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:38.036980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:38.045542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:38.046975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9c28b-a4df-46bc-8507-bd9fb0360e6a service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:38.056549 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1171/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:38.075268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:38.136204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d82fd-4feb-4666-8043-d9001925daaf None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:38.140840 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:38.141716 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:38.141998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:38.142278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] PATH_INFO: `/v3/users/bbf0f583f8514d268339a72506d88960` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:38.144127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf0f583f8514d268339a72506d88960)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:38.146087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:38.150563 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:38.333670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf0f583f8514d268339a72506d88960'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:38.334358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf0f583f8514d268339a72506d88960'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:38.334987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf0f583f8514d268339a72506d88960'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:38.347885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf0f583f8514d268339a72506d88960'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:38.354804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf0f583f8514d268339a72506d88960'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:38.439417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1202/2373] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:38 2022] DELETE /identity/v3/users/bbf0f583f8514d268339a72506d88960 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:38.444046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d894a-9128-417c-abe5-58792960a913 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:38.444333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d894a-9128-417c-abe5-58792960a913 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:38.444645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d894a-9128-417c-abe5-58792960a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:38.462585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-449d894a-9128-417c-abe5-58792960a913 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:38.463772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-449d894a-9128-417c-abe5-58792960a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:38.508206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:38.523676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1172/2374] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:38.533274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:38.534715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:38.598224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c71cf-1dc0-44d2-b12b-fa485db4bdfd admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:38.602145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:38.602832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:38.603118 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:38.603397 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:38.613808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:38.615256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9e99d-ff57-4174-8b90-81a6432f17f3 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:38.627461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1203/2375] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:39.071380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d894a-9128-417c-abe5-58792960a913 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.073184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-449d894a-9128-417c-abe5-58792960a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:39.088435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d894a-9128-417c-abe5-58792960a913 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.093225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.094096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.094372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.094641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] PATH_INFO: `/v3/projects/7ab3cd94a36a49ee9ba46dbac4df4b86` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.095870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab3cd94a36a49ee9ba46dbac4df4b86)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.099328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.240960 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab3cd94a36a49ee9ba46dbac4df4b86', 'request_id': 'req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:39.247237 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab3cd94a36a49ee9ba46dbac4df4b86', 'request_id': 'req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:39.253765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab3cd94a36a49ee9ba46dbac4df4b86', 'request_id': 'req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:39.322445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] The token cache is being invalidate because project 7ab3cd94a36a49ee9ba46dbac4df4b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:39.322735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:39.323406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aeed3b4-de02-41eb-b6f7-d9557f3e1f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:39.325120 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1173/2376] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:39 2022] DELETE /identity/v3/projects/7ab3cd94a36a49ee9ba46dbac4df4b86 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:39.330447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.330743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.331075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.351524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:39.352902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:39.414109 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1204/2377] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:39.422125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.422417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.422701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.441406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:39.442608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:39.450664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1174/2378] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:39.454850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.465284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45212bfc-93a0-4c20-bdcd-e7decb216ae3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.470198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.470859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.471141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.471418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.472407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:39.472744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.474427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.485943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1205/2379] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:39.490173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.499586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db1795-4f6e-4020-ac72-6ec72dd08f0f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.505004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.505660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.505959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.506220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.506909 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.508876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.600787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1175/2380] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:39 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:39.604901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.615545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfdce-caa7-4848-b221-6d20c0900d88 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.624507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:39.673274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.674271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.674752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.676057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.676723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.678701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.777202 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1206/2381] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:39 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:39.781271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.791706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40cc4-ad86-4cd6-b731-a96099bbb46e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.796360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.797057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.797341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.797619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.798380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.799990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.811545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1176/2382] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:39.815427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.826764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2db752-1d29-43ed-a2a3-6f0ffb686e3e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.832318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.832318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.832663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.832754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.833444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.835035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38e5bc-d9b9-4751-b487-01e10d376926 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.848421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1207/2383] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:39.850106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:39.860396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541da1-d57f-49f1-b30f-b513d059e900 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:39.865911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:39.866922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.867271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.867615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] PATH_INFO: `/v3/projects/868aa5b3addd4dba96fe39caff25a7a5/users/177771edf536482f9fad5c69ef229d73/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.883467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] RBAC: Authorizing `identity:create_grant(project_id=868aa5b3addd4dba96fe39caff25a7a5, user_id=177771edf536482f9fad5c69ef229d73, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:39.886174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:39.938194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1177/2384] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:39 2022] PUT /identity/v3/projects/868aa5b3addd4dba96fe39caff25a7a5/users/177771edf536482f9fad5c69ef229d73/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:39.952668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:39.952960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:39.953241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:39.980019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] MFA Rules not processed for user `177771edf536482f9fad5c69ef229d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:39.981259 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:40.046902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1208/2385] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:40.052138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.116585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf499-0dfb-423d-879f-be86a9f1506d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.121987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.122689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.122979 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.123258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.124233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.126241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.139815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:40.253713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1178/2386] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:40 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:40.257503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.268063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b753d-20f4-4cfb-811c-cbfb9a2b378c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.324478 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.325167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.325448 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.325723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.326402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.328327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.445499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1209/2387] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:40 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:40.449642 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.460442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e5ab0-b249-4254-b5fb-2d5cf9c8617e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.465022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.465744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.466022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.466293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.467013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.468690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.479763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1179/2388] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:40.483785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.494055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372e1a-7f1a-4b7a-8989-1adba68fa07f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.499185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.500133 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.500566 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.500850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] PATH_INFO: `/v3/projects/2698c2424e6849f08b91408aa4312829/users/ea3c30ed4bf04834984cf7c6548cc0d3/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.510065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:40.516605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2698c2424e6849f08b91408aa4312829, user_id=ea3c30ed4bf04834984cf7c6548cc0d3, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.520362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.591882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1210/2389] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:40 2022] PUT /identity/v3/projects/2698c2424e6849f08b91408aa4312829/users/ea3c30ed4bf04834984cf7c6548cc0d3/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:40.595843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.606624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6997-dc91-4ed7-bd5d-5788595d6ce7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.662590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.663248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.663531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.663804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.664551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.666148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2beb59-d5eb-4062-9cdc-78999bedc876 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.676457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1180/2390] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:40.680689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.691861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9598e5-31ce-4542-87dd-15b5191ac182 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.697317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.698147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.698465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.698710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] PATH_INFO: `/v3/projects/2698c2424e6849f08b91408aa4312829/users/ea3c30ed4bf04834984cf7c6548cc0d3/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.700767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2698c2424e6849f08b91408aa4312829, user_id=ea3c30ed4bf04834984cf7c6548cc0d3, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.703497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.714360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1211/2391] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:40 2022] PUT /identity/v3/projects/2698c2424e6849f08b91408aa4312829/users/ea3c30ed4bf04834984cf7c6548cc0d3/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:40.724748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.725036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.725314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.750998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] MFA Rules not processed for user `ea3c30ed4bf04834984cf7c6548cc0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:40.752191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:40.818973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1181/2392] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:40.829646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:40.831342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:40.890678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bdca5-8c37-43aa-aaf2-075794ab9667 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:40.895233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:40.896575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:40.896849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:40.897125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:40.955518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:40.956944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:40.966921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1212/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:45.934136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:45.935690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:46.012885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:46.038921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc7f6-a1d0-4e0a-985b-73c2450c92b5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:46.043926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:46.044617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:46.044904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:46.045183 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:46.046967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:46.059319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:46.060997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:46.070962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1182/2394] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:49.554635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:49.556113 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:49.576213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:49.649346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f85f-be46-4461-bc18-0e602062eb1d service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:49.649460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709870-1879-420e-a4ef-f6ca7f198013 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:49.652538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:49.653377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:49.653767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:49.654040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] PATH_INFO: `/v3/users/177771edf536482f9fad5c69ef229d73` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:49.654144 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:49.655050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:49.655302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=177771edf536482f9fad5c69ef229d73)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:49.655427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:49.655590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] PATH_INFO: `/v3/users/5c14cff9dd4247daac1400ec3610e68a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:49.656816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c14cff9dd4247daac1400ec3610e68a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:49.657376 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:49.658733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:49.885823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:49.900940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177771edf536482f9fad5c69ef229d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.901682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177771edf536482f9fad5c69ef229d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.902666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177771edf536482f9fad5c69ef229d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.910584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c14cff9dd4247daac1400ec3610e68a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.911210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c14cff9dd4247daac1400ec3610e68a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.914226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c14cff9dd4247daac1400ec3610e68a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.916295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177771edf536482f9fad5c69ef229d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.923489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f8b1fe6-34ab-4eec-8d2a-26e4fd19d59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177771edf536482f9fad5c69ef229d73'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.927513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c14cff9dd4247daac1400ec3610e68a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.936207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c14cff9dd4247daac1400ec3610e68a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:49.996313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1183/2395] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:49 2022] DELETE /identity/v3/users/177771edf536482f9fad5c69ef229d73 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:50.001063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab8d4-259d-418a-8d5a-ad92af3d4a32 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.001349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab8d4-259d-418a-8d5a-ad92af3d4a32 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.001634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab8d4-259d-418a-8d5a-ad92af3d4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.018826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-952ab8d4-259d-418a-8d5a-ad92af3d4a32 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:50.020022 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-952ab8d4-259d-418a-8d5a-ad92af3d4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:50.071274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:50.083594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1184/2396] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:50.096100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1213/2397] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:49 2022] DELETE /identity/v3/users/5c14cff9dd4247daac1400ec3610e68a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:50.097575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.097865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.098155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.099630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:50.102037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:50.118259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:50.120998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:50.166412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e93e1-8c44-420c-ad91-e2284d4191f5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:50.166728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:50.167387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.167679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.167959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.179176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1185/2398] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:50.195104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:50.201491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f10993-83cc-4e4a-a5b7-cafd22e89292 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:50.205800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:50.207839 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.208243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.208679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.219671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:50.221174 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:50.234093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1186/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:50.244956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:50.246733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:50.258835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1214/2400] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:50.890754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:50.892222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:50.919653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b56716-6273-4225-a757-9b4d97b3f403 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:50.924962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:50.925993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.926337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.926681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] PATH_INFO: `/v3/projects/868aa5b3addd4dba96fe39caff25a7a5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.928173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868aa5b3addd4dba96fe39caff25a7a5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:50.931706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:50.949298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:50.950776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:50.964964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ae92-5493-48c0-afbd-b02b4ad75d8b service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:50.970807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:50.973197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:50.973545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:50.973752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] PATH_INFO: `/v3/projects/7bc333a361e24bd6b4142f1a03ba0878` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:50.975088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc333a361e24bd6b4142f1a03ba0878)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:50.981679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:51.048127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868aa5b3addd4dba96fe39caff25a7a5', 'request_id': 'req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.055588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868aa5b3addd4dba96fe39caff25a7a5', 'request_id': 'req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.062063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868aa5b3addd4dba96fe39caff25a7a5', 'request_id': 'req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.130231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc333a361e24bd6b4142f1a03ba0878', 'request_id': 'req-0dd275c7-1554-4617-97cc-5b1b9b5d664f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.133199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:51.137879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc333a361e24bd6b4142f1a03ba0878', 'request_id': 'req-0dd275c7-1554-4617-97cc-5b1b9b5d664f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.171127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] The token cache is being invalidate because project 868aa5b3addd4dba96fe39caff25a7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:51.171586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.172246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.173948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1187/2401] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:50 2022] DELETE /identity/v3/projects/868aa5b3addd4dba96fe39caff25a7a5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:51.177944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:51.180179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:51.254768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1ff8-fb7b-4b2e-91e0-85aa1a272e81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:51.290701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc333a361e24bd6b4142f1a03ba0878', 'request_id': 'req-0dd275c7-1554-4617-97cc-5b1b9b5d664f'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.305129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] The token cache is being invalidate because project 7bc333a361e24bd6b4142f1a03ba0878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:51.305737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.306632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.313825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1215/2402] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:50 2022] DELETE /identity/v3/projects/7bc333a361e24bd6b4142f1a03ba0878 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:51.315152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:51.318522 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:51.327594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:51.334517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:51.334517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:51.334517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] PATH_INFO: `/v3/users/ea3c30ed4bf04834984cf7c6548cc0d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:51.334517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3c30ed4bf04834984cf7c6548cc0d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:51.334517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:51.389576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd275c7-1554-4617-97cc-5b1b9b5d664f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:51.394325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:51.395215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:51.395493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:51.395765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] PATH_INFO: `/v3/users/1b264019b2ed4e17a45622421db14958` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:51.396987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b264019b2ed4e17a45622421db14958)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:51.399651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:51.514182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:51.643443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3c30ed4bf04834984cf7c6548cc0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.644113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3c30ed4bf04834984cf7c6548cc0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.644769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3c30ed4bf04834984cf7c6548cc0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.656824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3c30ed4bf04834984cf7c6548cc0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.664137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3c30ed4bf04834984cf7c6548cc0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.707678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b264019b2ed4e17a45622421db14958'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.708347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b264019b2ed4e17a45622421db14958'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.709016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b264019b2ed4e17a45622421db14958'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.722034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b264019b2ed4e17a45622421db14958'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.729484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b264019b2ed4e17a45622421db14958'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:51.783983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1188/2403] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:51 2022] DELETE /identity/v3/users/ea3c30ed4bf04834984cf7c6548cc0d3 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:51.784846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:51.786191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:51.853606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63c68-e978-404a-974d-2e980ede5546 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:51.858704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:51.859666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:51.859976 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:51.860250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] PATH_INFO: `/v3/users/e83814156636426a82b44479d243edcc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:51.861491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83814156636426a82b44479d243edcc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:51.863557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:51.873209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1216/2404] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:51 2022] DELETE /identity/v3/users/1b264019b2ed4e17a45622421db14958 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:51.873209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:51.873209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:51.940092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f443-01fe-4236-8712-ecd9e3cedc79 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:51.945367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:51.947735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:51.947735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:51.947735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] PATH_INFO: `/v3/users/0521c6c333cb4cdf8cc8e9daa3ae5993` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:51.948083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0521c6c333cb4cdf8cc8e9daa3ae5993)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:51.949999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:52.152998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83814156636426a82b44479d243edcc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.153915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83814156636426a82b44479d243edcc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.154822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83814156636426a82b44479d243edcc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.168658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83814156636426a82b44479d243edcc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.176340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fef56ce7-b65f-4873-88de-84f3c2456fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83814156636426a82b44479d243edcc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.251047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0521c6c333cb4cdf8cc8e9daa3ae5993'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.253332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0521c6c333cb4cdf8cc8e9daa3ae5993'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.253332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0521c6c333cb4cdf8cc8e9daa3ae5993'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.265477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0521c6c333cb4cdf8cc8e9daa3ae5993'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.272134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0521c6c333cb4cdf8cc8e9daa3ae5993'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.283610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1189/2405] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:51 2022] DELETE /identity/v3/users/e83814156636426a82b44479d243edcc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:52.284356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.289281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.289281 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.306844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:52.308246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.387949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1190/2406] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:52.387949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:52.387949 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.418333 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b7634-e9d3-432e-bb62-3c513f072edb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:52.426794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1217/2407] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:51 2022] DELETE /identity/v3/users/0521c6c333cb4cdf8cc8e9daa3ae5993 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:52.427396 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:52.434029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:52.434172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.434172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.434172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] PATH_INFO: `/v3/projects/2698c2424e6849f08b91408aa4312829` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.434172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2698c2424e6849f08b91408aa4312829)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:52.434475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.434779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:52.507975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc596ae-a12d-4621-ac61-21f6505ef0b6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:52.514126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:52.514934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.515224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.515507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.583671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:52.585383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd16c-bfb7-4fe6-bfde-5286f9694314 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:52.597433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1218/2408] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:52.599248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.599543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.603989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.619153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:52.620375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.644351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2698c2424e6849f08b91408aa4312829', 'request_id': 'req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.653895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2698c2424e6849f08b91408aa4312829', 'request_id': 'req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.661048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2698c2424e6849f08b91408aa4312829', 'request_id': 'req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.719067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1219/2409] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:52.730617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:52.732345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.761982 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] The token cache is being invalidate because project 2698c2424e6849f08b91408aa4312829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:52.762324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.763524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72ab987d-f0b1-4e9a-9e78-e214e6e348a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:52.765669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1191/2410] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:52 2022] DELETE /identity/v3/projects/2698c2424e6849f08b91408aa4312829 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:52.771234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cdc4-0c36-4813-be56-bd733c7115ef None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.771723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cdc4-0c36-4813-be56-bd733c7115ef None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.772704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cdc4-0c36-4813-be56-bd733c7115ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.798254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8229cdc4-0c36-4813-be56-bd733c7115ef None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:52.800034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8229cdc4-0c36-4813-be56-bd733c7115ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.810127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e217f3-97d8-4807-a719-534c98d5675a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:52.812257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1192/2411] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:52.814168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:52.814869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.815156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.815437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.817381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.821309 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.821803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.822089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.831838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:52.833749 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:52.845315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:52.846862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:52.847601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1220/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:38:52.858983 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1193/2413] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:52.863241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:52.877558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314503-f6ae-4479-8f3d-0f50c0a7d070 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:52.885976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:52.886667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.886956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.887234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.888548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:52.888876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:52.890738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:52.916531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1221/2414] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:52.921086 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:52.922664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:52.935842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426ed0f-4ca2-4e48-9b26-179b8b011a0c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:52.943739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:52.944595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:52.945111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:52.945941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:52.946749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:52.949050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.143559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1194/2415] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:52 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:53.147491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.164810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c1b4-8fef-49fb-9e29-4237faefcc2f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.174075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.179620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:53.288122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:53.332735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f32ff-a610-4c2a-a7d7-2ed2c0d9607c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.334781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.336713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.337342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.338080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.339490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.340807 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.341232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.341525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.341800 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] PATH_INFO: `/v3/projects/09312610278d480f82fccab32e393e05` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.343025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=09312610278d480f82fccab32e393e05)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.344600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.348211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.442643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1222/2416] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:53 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:53.447891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.458226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff54c1-67fc-435e-ac98-df441cbb9e2a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.463713 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.464415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.464802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.465087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.465824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.467594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.478437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1223/2417] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:53.485909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.496778 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cb0d4-e46a-4a59-bc03-e07e29617d1c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.506422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.506422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.506422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.506422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.506818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.506818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.520715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1224/2418] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:38:53.524540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09312610278d480f82fccab32e393e05', 'request_id': 'req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.524995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.531280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09312610278d480f82fccab32e393e05', 'request_id': 'req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.537628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b64-a62e-4b49-ad33-e60cb1ce59a5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.541597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09312610278d480f82fccab32e393e05', 'request_id': 'req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.619101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.620238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.620626 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.620963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] PATH_INFO: `/v3/projects/ef6816d2122943ba80fd77219413f0d9/users/85952c82ff124ad9a0a046a7075e054a/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.631464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] The token cache is being invalidate because project 09312610278d480f82fccab32e393e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:53.631464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.631775 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.637778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1195/2419] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:53 2022] DELETE /identity/v3/projects/09312610278d480f82fccab32e393e05 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:53.637778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.637778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:53.643970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6816d2122943ba80fd77219413f0d9, user_id=85952c82ff124ad9a0a046a7075e054a, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.646811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.653275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21e76-b6b6-4071-bc4b-2e2c4ca0e0fb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.658141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.659005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.659284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.659557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] PATH_INFO: `/v3/projects/a6c145cef5494d4794a1fc08f56d6c21` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.660889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c145cef5494d4794a1fc08f56d6c21)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.662925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.723402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1225/2420] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:53 2022] PUT /identity/v3/projects/ef6816d2122943ba80fd77219413f0d9/users/85952c82ff124ad9a0a046a7075e054a/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:53.723402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:53.725862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:53.799898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c145cef5494d4794a1fc08f56d6c21', 'request_id': 'req-4245c008-16ef-44cd-9591-56a8ffc232db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.806606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c145cef5494d4794a1fc08f56d6c21', 'request_id': 'req-4245c008-16ef-44cd-9591-56a8ffc232db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.807994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b81e4-df50-4055-bd51-4509d0f4f6df admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:53.814602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c145cef5494d4794a1fc08f56d6c21', 'request_id': 'req-4245c008-16ef-44cd-9591-56a8ffc232db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.869020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:53.869891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.870173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.870450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] PATH_INFO: `/v3/projects/30a312a8c613442a99687f128cc29644` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.871641 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a312a8c613442a99687f128cc29644)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:53.873646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:53.953892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] The token cache is being invalidate because project a6c145cef5494d4794a1fc08f56d6c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:53.954256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.954921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4245c008-16ef-44cd-9591-56a8ffc232db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:53.956608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1196/2421] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:53 2022] DELETE /identity/v3/projects/a6c145cef5494d4794a1fc08f56d6c21 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:53.957971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce2801-0bab-48b5-bec0-25f02d971812 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.958296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce2801-0bab-48b5-bec0-25f02d971812 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.958639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce2801-0bab-48b5-bec0-25f02d971812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:53.976350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e0ce2801-0bab-48b5-bec0-25f02d971812 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:53.977488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0ce2801-0bab-48b5-bec0-25f02d971812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:53.985254 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1197/2422] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:53.986435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277796-5ce5-4d0f-bf74-7804388ae639 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:53.986718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277796-5ce5-4d0f-bf74-7804388ae639 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:53.986993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277796-5ce5-4d0f-bf74-7804388ae639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.013204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e1277796-5ce5-4d0f-bf74-7804388ae639 None None] MFA Rules not processed for user `85952c82ff124ad9a0a046a7075e054a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.014390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e1277796-5ce5-4d0f-bf74-7804388ae639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.014757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a312a8c613442a99687f128cc29644', 'request_id': 'req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:54.021176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a312a8c613442a99687f128cc29644', 'request_id': 'req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:54.076620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1198/2423] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.083249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac73-79e4-47a3-a188-c1e16f11e98e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.083538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac73-79e4-47a3-a188-c1e16f11e98e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.083832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac73-79e4-47a3-a188-c1e16f11e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.101685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5f5eac73-79e4-47a3-a188-c1e16f11e98e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.102835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f5eac73-79e4-47a3-a188-c1e16f11e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.160875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1199/2424] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.162299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdae0-795e-4bc2-8eb5-f612138168f4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.162596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdae0-795e-4bc2-8eb5-f612138168f4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.162876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdae0-795e-4bc2-8eb5-f612138168f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.172944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a312a8c613442a99687f128cc29644', 'request_id': 'req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:54.182131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-651cdae0-795e-4bc2-8eb5-f612138168f4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.183389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-651cdae0-795e-4bc2-8eb5-f612138168f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.185855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] The token cache is being invalidate because project 30a312a8c613442a99687f128cc29644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:38:54.186218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:54.186953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:54.188737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1226/2425] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:38:53 2022] DELETE /identity/v3/projects/30a312a8c613442a99687f128cc29644 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:54.189371 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.190633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.195338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1200/2426] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.200440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb8d6-1ff7-4044-81d3-1b13d344bc7e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.200776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb8d6-1ff7-4044-81d3-1b13d344bc7e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.201057 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb8d6-1ff7-4044-81d3-1b13d344bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.218954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-84aeb8d6-1ff7-4044-81d3-1b13d344bc7e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.220155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84aeb8d6-1ff7-4044-81d3-1b13d344bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.229259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1201/2427] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.230511 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.230797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.231075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.251510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.252427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221b4a-d034-4d4a-9c3d-9bc66c3e8e0d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.252847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.256178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.256865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.257904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.258183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.259930 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.262550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1202/2428] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.263503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.272677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.274859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.276542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e8a59-d3f8-47b7-af70-68e5a921d00d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.281681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.282336 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.282894 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.283170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.283893 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:54.284078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1227/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:54.284275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.284905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.286205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d25005-aa25-4d4b-9b81-9118984c2242 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.295359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1824e-0dc6-4fbd-bb78-b3f43c72e2f4 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.300333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.301115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.301401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.301871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.301980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1203/2430] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:54.302486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:54.302796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.303300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.303589 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.303911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.304735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.317170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1228/2431] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:54.317950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.328844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:54.329330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138557-3247-47b6-84d7-5ce1efd174d7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.330666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:54.334425 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.334897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.335183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.336038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.336890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.338843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.342906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1204/2432] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:54.342906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.353770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a583c-4ba4-4839-b8ab-15036c48b655 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.359350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.360012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.360299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.360600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.361291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.364132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.435447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1229/2433] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:54.435447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.473599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1205/2434] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:54.473599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.493924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99235f0e-980f-4406-8f29-2f61f80da6f3 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.537144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdcf1e-50d9-41e8-b188-85555bf0f893 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.541974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.542652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.542938 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.544548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.544548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.545848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.551594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.552270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.552575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.552854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.553710 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:38:54.554565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.556409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.569800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1230/2435] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:38:54.571322 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.573858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:54.584517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c5e-9392-440d-ab11-9ae9748ef68b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.590694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.591600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.591885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.592297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.593271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.595706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.663211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1206/2436] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:54.663955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.673283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a118e6-d3b9-4dcf-bde5-9d3f868b75b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.677875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.678503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.678784 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.679074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.680273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.682219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.737375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1231/2437] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:54.738400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.752481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f955-79f6-4597-b7b9-8fcc25a470a3 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.757231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.758767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.759056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.759334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.760072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.761732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.775507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1232/2438] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:54.776526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.787229 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ad59-577a-4b83-b373-6ee485a159ae admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.793524 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.794418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.794871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.795362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.796696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.806469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.813266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1233/2439] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:54.813266 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.825377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed2f0-190d-450d-a3ab-337b3f3a9c8d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.830660 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.831539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.831891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.832167 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.832998 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.834651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.844973 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1234/2440] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:54.850414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.850562 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1207/2441] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:54.853644 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.857722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d6eb-be49-4caf-9b8e-d76236c59f04 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.928903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.930047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.930493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.930765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.931511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.933197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.936919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893611-bfc9-47d6-a23d-5195e4d6646b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.942106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.943044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.943967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.943967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] PATH_INFO: `/v3/projects/39850f42d8294c30a26dae558ceb4cf1/users/5336164ba9274843a80ef007e6db74a0/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.947145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1235/2442] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:54.949007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:54.960974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362558-ec3f-4c04-b40d-18958280083e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:54.964809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39850f42d8294c30a26dae558ceb4cf1, user_id=5336164ba9274843a80ef007e6db74a0, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.965956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:54.966464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:54.967147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:54.967440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:54.968041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:54.968686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:54.972293 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd14f2d-a9ac-4dc6-8414-8f1f2e1ba8c2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.020897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:55.089623 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1208/2443] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:54 2022] PUT /identity/v3/projects/39850f42d8294c30a26dae558ceb4cf1/users/5336164ba9274843a80ef007e6db74a0/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:38:55.090803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.130701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1236/2444] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:54 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:55.133015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.133381 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.133678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.166070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] MFA Rules not processed for user `5336164ba9274843a80ef007e6db74a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:55.167343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:55.171202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09256765-5ee1-443e-8202-9d3ace24795e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.176877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.177773 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.178052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.178325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] PATH_INFO: `/v3/projects/36d5e955d9e6492782a1aad243d9bc4a/users/db6862894865435d988beebeebdd4aaf/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.201089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d5e955d9e6492782a1aad243d9bc4a, user_id=db6862894865435d988beebeebdd4aaf, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.201089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.250012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1237/2445] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:55.251188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.263913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc5560-fcd6-437e-b9fa-df33592c52bf None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.268732 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.269414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.269731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.270011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.270751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.272352 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.285798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1238/2446] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:55.285959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.299082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19b7a4-573d-4c63-9d7f-4825ea040057 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.304070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.306471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.306471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.306471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.306786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.309108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.351628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1209/2447] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:55 2022] PUT /identity/v3/projects/36d5e955d9e6492782a1aad243d9bc4a/users/db6862894865435d988beebeebdd4aaf/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:55.353025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.424766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267030-8bff-46d5-a5f2-09ef1eb4f692 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.430881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.437645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.437645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.437645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.437645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.437645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f9e5b-a9bf-4518-95da-b460421859d8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.447278 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1210/2448] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:55.448680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.448967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.449280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.472617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1239/2449] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:38:55 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:55.472617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.489245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] MFA Rules not processed for user `db6862894865435d988beebeebdd4aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:55.490614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:55.542965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306c458-6cfe-40b4-b5a1-658fec54ed4d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.548590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.549500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.549837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.550117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] PATH_INFO: `/v3/projects/0c50da3e76414a17a53e2a931b6bc715/users/3e83c8b08dba4ff0ae4a05395bd8f652/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.568508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c50da3e76414a17a53e2a931b6bc715, user_id=3e83c8b08dba4ff0ae4a05395bd8f652, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.572106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.579567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1211/2450] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:55.580395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.593854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31a56-1d79-494f-8e13-a9965d6ad413 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.598533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.599200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.599485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.599781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.600460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.603262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508f88e-d602-4d12-9734-ea411f0d3f08 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.654545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1240/2451] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:55 2022] PUT /identity/v3/projects/0c50da3e76414a17a53e2a931b6bc715/users/3e83c8b08dba4ff0ae4a05395bd8f652/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:55.655386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.709026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb551f3-346d-48dc-89df-01a4c5e90edd admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.713579 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.714228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.714514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.714796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.754209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1212/2452] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:38:55 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:38:55.754209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.754209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.754209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.771696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.773865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.781597 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] MFA Rules not processed for user `3e83c8b08dba4ff0ae4a05395bd8f652`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:55.782850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:55.785102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1241/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:55.785102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.864018 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1213/2454] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:55.871045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac736-bf1a-4fab-9f41-e67b8bca0949 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.876592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.877569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.877803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.879085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:55.879569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.879866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:55.880005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.880891 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.883383 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.893539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8569-24eb-4daa-982e-c8954d5d51cc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.897602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1242/2455] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:55.899402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:55.903741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.905301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.905748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.906190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.911500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b203d8-a13e-4900-bced-a0598292b233 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:55.916697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:55.923092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:55.923092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:55.923092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] PATH_INFO: `/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8/users/66ff05ef803f4018860e879569bfbf60/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:55.927098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.929233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.935989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:55.936859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a0f57d93b54e3b872afa3c17f8c3b8, user_id=66ff05ef803f4018860e879569bfbf60, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:55.939759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:55.944594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1214/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:56.022866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1243/2457] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:55 2022] PUT /identity/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8/users/66ff05ef803f4018860e879569bfbf60/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:56.027653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:56.038786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19910-13fb-45a5-beff-eeced97f066b service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:56.099335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:56.099977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.100260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.100569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.101326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:56.102942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52ac0-c4c0-41bb-8cf9-aa79e39a01ec admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:56.116372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1215/2458] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:38:56.118129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:56.128872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239499-4efe-4380-9e1a-439708073fa7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:56.134782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:56.135669 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.135945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.136222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] PATH_INFO: `/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8/users/66ff05ef803f4018860e879569bfbf60/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.138455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a0f57d93b54e3b872afa3c17f8c3b8, user_id=66ff05ef803f4018860e879569bfbf60, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:56.141317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:56.151739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1244/2459] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:38:56 2022] PUT /identity/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8/users/66ff05ef803f4018860e879569bfbf60/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:56.162756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265374-6616-40ee-8ef8-1d415399f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.163047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265374-6616-40ee-8ef8-1d415399f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.163411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265374-6616-40ee-8ef8-1d415399f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.180301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:56.190811 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-13265374-6616-40ee-8ef8-1d415399f1a6 None None] MFA Rules not processed for user `66ff05ef803f4018860e879569bfbf60`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:56.192083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-13265374-6616-40ee-8ef8-1d415399f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:56.263646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1216/2460] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:56.528278 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:56.536571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.536951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.537235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.554426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] MFA Rules not processed for user `94d49cbc2d5d458881d3c2a5880f9109`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:56.555654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:56.585802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f98cc-1963-4533-bf64-eaa5677f5019 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:56.590380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:56.591031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.591313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.591587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.601164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:56.603187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b92c7-fe47-4e51-a66b-bdf9839806c4 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:56.610728 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1217/2461] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:38:56.616130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1245/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:56.743457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:56.807083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:56.818538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba9750-a05c-4e3d-8ef5-228c85055a00 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:56.824215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:56.825077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:56.825464 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:56.828835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:56.901618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:56.903273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:56.913103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1218/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:38:57.198917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:57.390796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:57.972149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:58.097893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:58.293907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:58.391188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:58.870789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef021-ab2c-48e7-b910-3ce8e61a4d1c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:58.870789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef021-ab2c-48e7-b910-3ce8e61a4d1c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:58.871089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef021-ab2c-48e7-b910-3ce8e61a4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:58.894206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-720ef021-ab2c-48e7-b910-3ce8e61a4d1c None None] MFA Rules not processed for user `3e83c8b08dba4ff0ae4a05395bd8f652`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:58.895497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-720ef021-ab2c-48e7-b910-3ce8e61a4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:58.976982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1246/2464] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:59.208095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:59.209610 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:59.286590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10928-703b-419f-8cc6-b55184326228 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:59.291748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:59.292667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:59.292948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:59.293225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] PATH_INFO: `/v3/users/85952c82ff124ad9a0a046a7075e054a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:59.294446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85952c82ff124ad9a0a046a7075e054a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:59.296414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:59.482777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85952c82ff124ad9a0a046a7075e054a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:59.482777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85952c82ff124ad9a0a046a7075e054a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:59.482777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85952c82ff124ad9a0a046a7075e054a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:59.493812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85952c82ff124ad9a0a046a7075e054a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:59.500577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85952c82ff124ad9a0a046a7075e054a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:38:59.581408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1219/2465] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:38:59 2022] DELETE /identity/v3/users/85952c82ff124ad9a0a046a7075e054a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:38:59.583290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:59.584569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:59.585114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:59.610162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:38:59.610162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:59.628796 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:59.668720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1247/2466] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:38:59.678318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:38:59.680413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:38:59.721906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:59.739328 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93edd4-17e6-4baa-be52-7a760343f158 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:38:59.743348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:38:59.746068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:38:59.746068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:38:59.746068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:38:59.755715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:38:59.757192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:38:59.768770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1220/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:00.233458 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:00.234903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:00.249498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f35a7-c7b0-45d4-9623-054214503f8a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:00.254578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:00.255449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:00.255848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:00.256009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] PATH_INFO: `/v3/projects/ef6816d2122943ba80fd77219413f0d9` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:00.257236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6816d2122943ba80fd77219413f0d9)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:00.259158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:00.420356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6816d2122943ba80fd77219413f0d9', 'request_id': 'req-0b78cedc-cd61-4b1c-9b72-766368f84f65'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:00.426489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6816d2122943ba80fd77219413f0d9', 'request_id': 'req-0b78cedc-cd61-4b1c-9b72-766368f84f65'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:00.591159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6816d2122943ba80fd77219413f0d9', 'request_id': 'req-0b78cedc-cd61-4b1c-9b72-766368f84f65'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:00.607070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] The token cache is being invalidate because project ef6816d2122943ba80fd77219413f0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:00.607529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:00.608428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-0b78cedc-cd61-4b1c-9b72-766368f84f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:00.610744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1248/2468] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:00 2022] DELETE /identity/v3/projects/ef6816d2122943ba80fd77219413f0d9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:04.297213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:04.298710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:04.312934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4692-eea2-4e07-b3d0-dae7bcb03a95 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:04.400097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:04.401009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:04.401655 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:04.402138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] PATH_INFO: `/v3/users/5336164ba9274843a80ef007e6db74a0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:04.403525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5336164ba9274843a80ef007e6db74a0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:04.405645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:04.704279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5336164ba9274843a80ef007e6db74a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:04.705268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5336164ba9274843a80ef007e6db74a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:04.705921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5336164ba9274843a80ef007e6db74a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:04.719779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5336164ba9274843a80ef007e6db74a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:04.726989 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5336164ba9274843a80ef007e6db74a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:04.826843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1221/2469] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:39:04 2022] DELETE /identity/v3/users/5336164ba9274843a80ef007e6db74a0 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:04.829852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:04.830828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:04.831426 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:04.868469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:04.875901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:04.957376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1249/2470] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:04.967958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:04.969541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:05.035011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8658-45c4-4b8d-aadd-351fd6c9dd3b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:05.039142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:05.040015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:05.040437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:05.040743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:05.062605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:05.062605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:05.062605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:05.065215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1222/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:05.933582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:05.934065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:05.974146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbdd2-1be9-488f-9945-539b048916e4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:05.980987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:05.982166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:05.982560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:05.982933 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] PATH_INFO: `/v3/projects/39850f42d8294c30a26dae558ceb4cf1` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:05.984234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39850f42d8294c30a26dae558ceb4cf1)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:05.990907 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:06.178141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:06.189636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39850f42d8294c30a26dae558ceb4cf1', 'request_id': 'req-49f85844-0b72-4ee2-9206-ec1f69731f0b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.196576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39850f42d8294c30a26dae558ceb4cf1', 'request_id': 'req-49f85844-0b72-4ee2-9206-ec1f69731f0b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.275764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39850f42d8294c30a26dae558ceb4cf1', 'request_id': 'req-49f85844-0b72-4ee2-9206-ec1f69731f0b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.293922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] The token cache is being invalidate because project 39850f42d8294c30a26dae558ceb4cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:06.294260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.294926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.301402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1250/2472] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:05 2022] DELETE /identity/v3/projects/39850f42d8294c30a26dae558ceb4cf1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:06.301766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:06.317768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfd0e-522c-4a14-a29e-5f9f1de2ec74 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:06.382270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:06.382270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:06.382270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:06.382270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] PATH_INFO: `/v3/users/66ff05ef803f4018860e879569bfbf60` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:06.382766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ff05ef803f4018860e879569bfbf60)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:06.384048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:06.812816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ff05ef803f4018860e879569bfbf60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.814147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ff05ef803f4018860e879569bfbf60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.815049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ff05ef803f4018860e879569bfbf60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.832403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ff05ef803f4018860e879569bfbf60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.844641 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ff05ef803f4018860e879569bfbf60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:06.939242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1223/2473] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:39:06 2022] DELETE /identity/v3/users/66ff05ef803f4018860e879569bfbf60 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:07.926816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:07.928261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:07.942022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85844-0b72-4ee2-9206-ec1f69731f0b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:07.991461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:07.993455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:08.006188 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.006307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.007058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.007333 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] PATH_INFO: `/v3/users/db6862894865435d988beebeebdd4aaf` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.008601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6862894865435d988beebeebdd4aaf)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.011507 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.073047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7ddf-36cb-4554-ad38-4d5f7c084789 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.073047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.073992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.074916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.075196 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] PATH_INFO: `/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.076403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a0f57d93b54e3b872afa3c17f8c3b8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.078432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.102680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:08.261639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a0f57d93b54e3b872afa3c17f8c3b8', 'request_id': 'req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.262817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6862894865435d988beebeebdd4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.263466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6862894865435d988beebeebdd4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.264071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6862894865435d988beebeebdd4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.267927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a0f57d93b54e3b872afa3c17f8c3b8', 'request_id': 'req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.273628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a0f57d93b54e3b872afa3c17f8c3b8', 'request_id': 'req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.276034 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6862894865435d988beebeebdd4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.283289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dd142b95-b45b-4173-bb64-d2ca1c2bda18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6862894865435d988beebeebdd4aaf'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.395730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] The token cache is being invalidate because project f8a0f57d93b54e3b872afa3c17f8c3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:08.396021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.396714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c21c837d-6cd4-4dad-9b19-f5eb7aa8361d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:08.398270 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1224/2474] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:07 2022] DELETE /identity/v3/projects/f8a0f57d93b54e3b872afa3c17f8c3b8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:08.403863 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fee7-2781-4185-bbdb-3ec67be8c47e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.404148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fee7-2781-4185-bbdb-3ec67be8c47e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.404424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1fee7-2781-4185-bbdb-3ec67be8c47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.423233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ddd1fee7-2781-4185-bbdb-3ec67be8c47e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:08.424480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ddd1fee7-2781-4185-bbdb-3ec67be8c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:08.478414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1251/2475] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:39:07 2022] DELETE /identity/v3/users/db6862894865435d988beebeebdd4aaf => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:08.484166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.484462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.484777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.490676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1225/2476] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:08.498619 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.498906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.499204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.504820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:08.506059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:08.518299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:08.519584 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:08.551286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:08.566850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1252/2477] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:08.576358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.577699 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:08.581112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1226/2478] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:08.585251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.595331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a844-4894-40e1-b757-4e142a94ab21 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.600423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.601123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.601403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.601675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.602399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:39:08.602705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.604311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.616550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1227/2479] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:39:08.621615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.631413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe59d21-424d-4c1c-ae49-f96ad095496d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.637529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.638195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.638482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.638776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.639162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f065f-9337-4f04-885b-ed614411b2a0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.639457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.641530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.643797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.644451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.644755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.646948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.655219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.656728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.666694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1253/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:39:08.743488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1228/2481] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:39:08 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:39:08.744964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.755775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415f55d-2424-4651-8dfc-d381eea8346c service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.812683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.813390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.813761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.814127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.814729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.816718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.932931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1254/2482] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:39:08 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:08.936210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.948606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e472c-9fad-4070-a47e-8adba0cb3c3e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.954867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.957142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.957142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.957142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.957705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.960576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:08.975700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1229/2483] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:08.977039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:08.988841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2046-b37d-464b-a4ef-1374d7a58a92 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:08.994028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:08.995288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:08.995288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:08.996022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:08.997317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:08.999274 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.012362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1255/2484] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:39:09.016304 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.032337 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facc160-50d2-4530-ae60-2b3c19127d09 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.037535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.038661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.038937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.039208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] PATH_INFO: `/v3/projects/6607f0040eeb490cae2591bca38c359e/users/2498e939cf284514b7fedc50e4bc7544/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.054323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6607f0040eeb490cae2591bca38c359e, user_id=2498e939cf284514b7fedc50e4bc7544, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.057061 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d4005-db12-4342-8269-bf86f23030f9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.148452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.150283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:09.150681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1230/2485] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:09 2022] PUT /identity/v3/projects/6607f0040eeb490cae2591bca38c359e/users/2498e939cf284514b7fedc50e4bc7544/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:09.160959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.161468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.161961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.163863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f206a9-280c-452a-bc02-12f03a7fa214 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.218004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] MFA Rules not processed for user `2498e939cf284514b7fedc50e4bc7544`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:09.219256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:09.236789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.244183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.244183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.244183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] PATH_INFO: `/v3/projects/36d5e955d9e6492782a1aad243d9bc4a` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.244183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d5e955d9e6492782a1aad243d9bc4a)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.244183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.290646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:09.294431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1231/2486] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:09.305848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.307335 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:09.346750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d5e955d9e6492782a1aad243d9bc4a', 'request_id': 'req-3954736b-97e8-4f32-ba1c-107dd6f69179'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:09.353733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d5e955d9e6492782a1aad243d9bc4a', 'request_id': 'req-3954736b-97e8-4f32-ba1c-107dd6f69179'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:09.391780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc57e-c6a9-4f31-b4ed-88cc436e6533 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.435940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d5e955d9e6492782a1aad243d9bc4a', 'request_id': 'req-3954736b-97e8-4f32-ba1c-107dd6f69179'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:09.440503 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.441219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.441502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.441774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.450002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] The token cache is being invalidate because project 36d5e955d9e6492782a1aad243d9bc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:09.450355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:09.451142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3954736b-97e8-4f32-ba1c-107dd6f69179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:09.453560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1256/2487] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:09 2022] DELETE /identity/v3/projects/36d5e955d9e6492782a1aad243d9bc4a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:09.459545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.460005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.460411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.478543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:09.480477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:09.499298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.500821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511202f-da1d-44bb-90b4-3d66b4e0a663 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.510507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1232/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:39:09.540594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1257/2489] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:09.550421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.552319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.552319 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.569660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:09.570856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:09.579248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1233/2490] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:09.583648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.595995 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9702-361a-46e7-a476-0d905e5db7e7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.600743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.601680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.601961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.602234 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.603064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:39:09.603369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.606099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.622568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1258/2491] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:39:09.624922 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.633151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:09.634846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249820c-e40d-4e98-b269-f98b44616af4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.640817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.641486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.641765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.642037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.642729 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.644721 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.709532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1234/2492] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:39:09 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:39:09.713503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.725387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df364885-97ac-4e52-940b-3a6820357934 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.786571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.787272 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.787560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.787846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.788675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.790686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.916007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1259/2493] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:39:09 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:09.917273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.928065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609157e-25cb-4a3b-970a-1face987cdf6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.932875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.933671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.933971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.934230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.934968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.936668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.950656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1235/2494] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:09.951947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.962548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746cebf-026a-4530-b61e-6b62e1593189 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:09.967884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:09.968582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:09.968870 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:09.969149 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:09.969877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:09.971485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8fb73-5de5-41d0-96cb-8bb51db9f9d3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:09.981895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1260/2495] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:09.986351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:09.996454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220306f-671a-409e-8e33-419ea65d09fa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:10.001405 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:10.002282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:10.002559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:10.002831 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] PATH_INFO: `/v3/projects/99326774c10c4169abea6d2e8d1684cb/users/cff0237c656b4f63944035d4931559ff/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:10.018525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99326774c10c4169abea6d2e8d1684cb, user_id=cff0237c656b4f63944035d4931559ff, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:10.023524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:10.142042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1236/2496] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:09 2022] PUT /identity/v3/projects/99326774c10c4169abea6d2e8d1684cb/users/cff0237c656b4f63944035d4931559ff/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:10.154134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:10.154377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:10.154659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:10.193939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] MFA Rules not processed for user `cff0237c656b4f63944035d4931559ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:10.205745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:10.258424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:10.263035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1261/2497] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:10.274462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:10.276223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:10.300801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:10.341779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c233-2b4e-4bcf-9139-90fe3bc75556 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:10.346608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:10.347478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:10.347974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:10.348427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:10.359238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:10.360724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f27b5-18ab-4402-8997-78ea62c68ecc service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:10.372155 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1237/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:10.402789 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:10.474993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6ef9-41da-46f2-b2ac-f5599a75f371 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:10.479855 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:10.481155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:10.481440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:10.481721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] PATH_INFO: `/v3/users/cff0237c656b4f63944035d4931559ff` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:10.482974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff0237c656b4f63944035d4931559ff)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:10.484952 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:10.753138 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff0237c656b4f63944035d4931559ff'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:10.754095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff0237c656b4f63944035d4931559ff'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:10.754711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff0237c656b4f63944035d4931559ff'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:10.767404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff0237c656b4f63944035d4931559ff'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:10.774265 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff0237c656b4f63944035d4931559ff'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:10.930069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1262/2499] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:39:10 2022] DELETE /identity/v3/users/cff0237c656b4f63944035d4931559ff => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:10.935547 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:10.935837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:10.936113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:10.953999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:10.955204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:11.007954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:11.017820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1238/2500] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:11.033288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:11.035552 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:11.061602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:11.100587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414dea0-a49c-4398-b82a-ee4649c54220 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:11.104255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:11.104977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:11.105829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:11.106111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:11.115889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:11.117364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1788c4d-25dc-44c3-8b8e-fbc03eecb219 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:11.127504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1263/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:11.629397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:11.631412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:11.645083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ddd8-edaa-46ae-a269-7a524755b17c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:11.654466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:11.655690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:11.656144 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:11.656472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] PATH_INFO: `/v3/projects/99326774c10c4169abea6d2e8d1684cb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:11.657953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99326774c10c4169abea6d2e8d1684cb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:11.660170 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:11.781926 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99326774c10c4169abea6d2e8d1684cb', 'request_id': 'req-35bc3b3f-4225-4023-89f9-36e68611abc2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:11.788074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99326774c10c4169abea6d2e8d1684cb', 'request_id': 'req-35bc3b3f-4225-4023-89f9-36e68611abc2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:11.794130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99326774c10c4169abea6d2e8d1684cb', 'request_id': 'req-35bc3b3f-4225-4023-89f9-36e68611abc2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:11.866716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] The token cache is being invalidate because project 99326774c10c4169abea6d2e8d1684cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:11.867009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:11.867730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35bc3b3f-4225-4023-89f9-36e68611abc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:11.869332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1239/2502] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:11 2022] DELETE /identity/v3/projects/99326774c10c4169abea6d2e8d1684cb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:11.875496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:11.875784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:11.876065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:11.895428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:11.896723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:11.960106 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1264/2503] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:11.968258 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:11.968577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:11.968858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:11.987539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:11.988679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:11.999249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1240/2504] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:12.001848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.013119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23493e-a384-49e6-b169-7bb8cb63ea26 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.017674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.018384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.018616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.018885 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.019601 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:39:12.019923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.021607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.033720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1265/2505] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:39:12.037948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.047432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d746094-83f6-4310-b0d8-95be4def6faa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.052171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.052951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.053247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.053524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.054220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.056136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.138126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1241/2506] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:39:12 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:12.142125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.152912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074afa-1977-4dee-b72f-ac5663eff18e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.210346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.211030 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.211487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.211844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.212647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.216584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.300668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1266/2507] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:39:12 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:39:12.304005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.314749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497bd64-7907-4d0b-a5b5-2386dbe272c3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.324849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.324849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.324849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.324849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.325317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.325317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.334374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1242/2508] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:12.338209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.349038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2aec4-e949-4590-b3ac-7757f9493e60 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.353794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.354456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.354743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.355038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.356367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.357540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1593-be64-43fe-94e2-cef088283d10 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.367422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1267/2509] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:12.372372 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.383339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f11a-4c55-48c8-9b5e-0a02417af557 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.390056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.391535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.391832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.392113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] PATH_INFO: `/v3/projects/86160ae3ef564baa92ba603c13d0bf5b/users/8c2e294be3d7494b80f994c7f58475c8/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.411625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86160ae3ef564baa92ba603c13d0bf5b, user_id=8c2e294be3d7494b80f994c7f58475c8, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.414439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.548123 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1243/2510] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:12 2022] PUT /identity/v3/projects/86160ae3ef564baa92ba603c13d0bf5b/users/8c2e294be3d7494b80f994c7f58475c8/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:12.553774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841039-c7a3-44a6-866a-443c8d7c0bb0 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.554041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841039-c7a3-44a6-866a-443c8d7c0bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.554316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841039-c7a3-44a6-866a-443c8d7c0bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.577677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ba841039-c7a3-44a6-866a-443c8d7c0bb0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:12.578915 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ba841039-c7a3-44a6-866a-443c8d7c0bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:12.603894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:12.661821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1268/2511] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:12.671489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:12.673325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:12.753469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c195962-29da-4f25-8a1a-ae5eb66e5436 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:12.759769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:12.760573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:12.760984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:12.761401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:12.772441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:12.773978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:12.786524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1244/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:18.886896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:18.887725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:18.887725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:18.922672 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] MFA Rules not processed for user `8c2e294be3d7494b80f994c7f58475c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:18.923912 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:19.008738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1269/2513] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:19.013546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.032797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e730-b139-4ba5-b668-7e2da24f0f2d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.038327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.039070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.039485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.039861 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.040715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.047661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.143731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:19.150527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1245/2514] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:39:19 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:19.154892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.167270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a81c8-935e-4d0a-99e3-ac169082dc76 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.243122 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.243735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.244023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.244303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.245056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.247708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.332586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1270/2515] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:39:19 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:19.336896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.370394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6b9f-3b1d-4aad-8555-0b4616ba5d36 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.378399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.379479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.380169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.380674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.382199 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.384564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.414595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1246/2516] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:19.416284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.428620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9c2d-4f19-476e-8239-d659ce3dfe15 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.433882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.434810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.435096 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.435378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] PATH_INFO: `/v3/projects/559225b3c9014690a5ecd138e3e2a75c/users/49a1beb869f44b8484811b7eb3e6f670/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.468666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559225b3c9014690a5ecd138e3e2a75c, user_id=49a1beb869f44b8484811b7eb3e6f670, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.474988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.565270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1271/2517] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:19 2022] PUT /identity/v3/projects/559225b3c9014690a5ecd138e3e2a75c/users/49a1beb869f44b8484811b7eb3e6f670/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:39:19.569462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.584542 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e38e-327d-41d7-a787-b233830666ff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.688282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.689058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.689344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.690216 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.691019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.692694 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344abb25-6e11-4525-94d0-4c51511c9c97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.707386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1247/2518] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:19.712279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:19.728767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068ee17-f0c0-47ae-b6cd-89147dea02a5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:19.746432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:19.748064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:19.748345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:19.748664 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] PATH_INFO: `/v3/projects/559225b3c9014690a5ecd138e3e2a75c/users/49a1beb869f44b8484811b7eb3e6f670/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:19.751303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559225b3c9014690a5ecd138e3e2a75c, user_id=49a1beb869f44b8484811b7eb3e6f670, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:19.753919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:19.766153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1272/2519] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:19 2022] PUT /identity/v3/projects/559225b3c9014690a5ecd138e3e2a75c/users/49a1beb869f44b8484811b7eb3e6f670/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:25.150163 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:25.150630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:25.150779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:25.253486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:25.255190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:25.298067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:25.299867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:25.311454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:25.365605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1248/2520] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:25.379083 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4ea1-ed6d-4785-83cc-e28f320a27d6 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:25.390102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:25.391286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:25.391794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:25.392295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:25.395803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:25.431821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:25.433498 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:25.489583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:25.491526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542a32-eafc-40fa-b201-8411ffee539a service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:25.503966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1273/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:39:25.514039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:25.571050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed097b-d2d3-4868-81cb-5d4ea7931d8b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:25.576574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:25.577275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:25.577559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:25.577834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:25.588684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:25.590295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:25.599673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1249/2522] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:39:26.890120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc078-8fcc-4182-9a77-377fce48db84 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:26.890600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc078-8fcc-4182-9a77-377fce48db84 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:26.890681 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc078-8fcc-4182-9a77-377fce48db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:26.913346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9f7dc078-8fcc-4182-9a77-377fce48db84 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:26.918261 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9f7dc078-8fcc-4182-9a77-377fce48db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:26.942466 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:26.951517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1274/2523] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:26.959276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871321-6904-4f26-9670-f55af6e731e3 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:26.965585 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:26.966257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:26.966674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:26.967224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:26.977066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:26.978757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:26.993961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1250/2524] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:39:27.092763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a18da-b21e-4ff0-a8ba-d6ce354cbfe8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:27.093830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a18da-b21e-4ff0-a8ba-d6ce354cbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:27.094260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a18da-b21e-4ff0-a8ba-d6ce354cbfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:27.136186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2d5a18da-b21e-4ff0-a8ba-d6ce354cbfe8 None None] MFA Rules not processed for user `49a1beb869f44b8484811b7eb3e6f670`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:27.137910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2d5a18da-b21e-4ff0-a8ba-d6ce354cbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:27.236241 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1275/2525] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:27.250900 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:27.252746 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:27.362765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596cce8-e551-4e80-a245-dc0212a70928 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:27.369837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:27.370556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:27.371392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:27.371392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:27.458323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:27.459628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:27.480887 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1251/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:27.774419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536fed-ca3f-4dcd-8d6e-d687b806f35e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:27.774990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536fed-ca3f-4dcd-8d6e-d687b806f35e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:27.775551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536fed-ca3f-4dcd-8d6e-d687b806f35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:27.813532 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-7a536fed-ca3f-4dcd-8d6e-d687b806f35e None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:27.818359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7a536fed-ca3f-4dcd-8d6e-d687b806f35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:27.835759 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1276/2527] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:27.852482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:27.873885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb470-9679-4388-8fc0-70266ccccf9b service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:27.903166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:27.903866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:27.906222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:27.906222 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:27.933990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:27.937490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:27.956322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1252/2528] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:39:28.871301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ba3d-40a2-4730-8cc8-8ff5e71d7899 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:28.871808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ba3d-40a2-4730-8cc8-8ff5e71d7899 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:28.871893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ba3d-40a2-4730-8cc8-8ff5e71d7899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:28.893068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0df9ba3d-40a2-4730-8cc8-8ff5e71d7899 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:28.894424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0df9ba3d-40a2-4730-8cc8-8ff5e71d7899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:28.918312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1277/2529] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:39:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:28.932916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:28.939705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:28.946843 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b38b3e-d577-4e93-bb88-9579a2bfe9d8 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:28.952761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:28.953574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:28.953950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:28.954290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:28.964659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:28.966403 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:28.976052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1253/2530] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:39:30.693618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db801-9a22-4af8-b8ae-189dc1e17104 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:30.694117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db801-9a22-4af8-b8ae-189dc1e17104 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:30.694496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db801-9a22-4af8-b8ae-189dc1e17104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:30.713446 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1f6db801-9a22-4af8-b8ae-189dc1e17104 None None] MFA Rules not processed for user `8c2e294be3d7494b80f994c7f58475c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:30.714684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1f6db801-9a22-4af8-b8ae-189dc1e17104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:30.722399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1278/2531] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:31.928391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:31.930406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:32.031796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4341f8-581a-467f-bd1c-02cddf58cdcb service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:32.036567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:32.037611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:32.037892 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:32.038162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] PATH_INFO: `/v3/users/3e83c8b08dba4ff0ae4a05395bd8f652` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:32.039382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e83c8b08dba4ff0ae4a05395bd8f652)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:32.041365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:32.235338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e83c8b08dba4ff0ae4a05395bd8f652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:32.236096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e83c8b08dba4ff0ae4a05395bd8f652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:32.236673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e83c8b08dba4ff0ae4a05395bd8f652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:32.276324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e83c8b08dba4ff0ae4a05395bd8f652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:32.289149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e83c8b08dba4ff0ae4a05395bd8f652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:32.379599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1254/2532] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:39:31 2022] DELETE /identity/v3/users/3e83c8b08dba4ff0ae4a05395bd8f652 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:39:32.384612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296254b-8397-4046-8be6-1652a156a068 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:32.385090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296254b-8397-4046-8be6-1652a156a068 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:32.386690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296254b-8397-4046-8be6-1652a156a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:32.406963 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4296254b-8397-4046-8be6-1652a156a068 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:32.408451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4296254b-8397-4046-8be6-1652a156a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:32.426158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:32.485881 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1279/2533] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:39:32.495572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:32.497037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:32.566436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8ce0-8990-42d0-80be-29f2679026e9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:32.570098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:32.570753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:32.571167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:32.571571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:32.581546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:32.583074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f7ef-f339-4e95-87a9-859dd2a39995 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:32.594850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1255/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:32.873346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296254b-8397-4046-8be6-1652a156a068 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:32.875530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4296254b-8397-4046-8be6-1652a156a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:32.894620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296254b-8397-4046-8be6-1652a156a068 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:32.903018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:32.905721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:32.905942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:32.906318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] PATH_INFO: `/v3/projects/0c50da3e76414a17a53e2a931b6bc715` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:32.908362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c50da3e76414a17a53e2a931b6bc715)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:32.911875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.042230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c50da3e76414a17a53e2a931b6bc715', 'request_id': 'req-f6747721-c384-4c0f-8db9-ae2934c41638'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:33.049774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c50da3e76414a17a53e2a931b6bc715', 'request_id': 'req-f6747721-c384-4c0f-8db9-ae2934c41638'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:33.115344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c50da3e76414a17a53e2a931b6bc715', 'request_id': 'req-f6747721-c384-4c0f-8db9-ae2934c41638'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:33.127079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] The token cache is being invalidate because project 0c50da3e76414a17a53e2a931b6bc715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:39:33.127360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:33.128026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f6747721-c384-4c0f-8db9-ae2934c41638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:39:33.129629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1280/2535] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:39:32 2022] DELETE /identity/v3/projects/0c50da3e76414a17a53e2a931b6bc715 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:33.134945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.135424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.135516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.154117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:33.155962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:33.161778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:33.221260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1256/2536] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:33.229378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.229784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.230136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.248301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:33.249714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:33.258253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1281/2537] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:33.262718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.273007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b1369-a676-421c-b0c7-aa62e001e760 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.277551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.278205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.278491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.278765 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.279543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:39:33.279859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.283169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.294984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1257/2538] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:39:33.299483 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.309076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5c7b8-d065-44a5-a5dd-8eeaddeafe78 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.313937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.314617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.314927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.315226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.315926 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.317959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.444620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1282/2539] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:39:33 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:39:33.445764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.456621 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568863c6-0373-42fa-8215-72758c2b2096 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.517025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.517759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.518040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.518314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.519016 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.521096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.662318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1258/2540] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:39:33 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:39:33.666723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.677567 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decc7a8-5500-4a28-831b-83b133076fbc admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.682307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.682979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.683264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.683569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.684297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.685972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.697116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1283/2541] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:33.701085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.712021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36fef0-948d-4ec6-9bf3-401648705cc0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.716782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.717452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.717733 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.718128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.718895 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.720530 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093c2d-95d7-4c8b-b0c3-329da6523811 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.730519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1259/2542] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:39:33.734678 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.745072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602d5f6-990d-410b-b5c7-9d182f58a80b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:33.750774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:33.751682 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.751970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.752248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] PATH_INFO: `/v3/projects/3d49b818ed404261bbb65e0c496ec17e/users/99d50bb0feb049b39233f3ec8111bafc/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.768353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d49b818ed404261bbb65e0c496ec17e, user_id=99d50bb0feb049b39233f3ec8111bafc, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:33.771077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:33.852914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1284/2543] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:39:33 2022] PUT /identity/v3/projects/3d49b818ed404261bbb65e0c496ec17e/users/99d50bb0feb049b39233f3ec8111bafc/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:39:33.864340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:33.864664 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:33.864948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:33.894347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] MFA Rules not processed for user `99d50bb0feb049b39233f3ec8111bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:39:33.895571 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:33.961102 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1260/2544] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:39:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:39:33.971816 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:39:33.973556 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:39:34.017698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:34.032348 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca5b3-dbaf-428e-a672-3384385d45ec admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:39:34.036151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:39:34.036832 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:39:34.037115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:39:34.037390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:39:34.045622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:39:34.047791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732e17-135b-42f5-a290-74d590606dc5 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:39:34.057271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1285/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:39:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:39:43.958096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:44.126300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=9 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:12.584263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:12.649941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561abbe-fe7a-4ceb-88d8-cea0f531d367 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:12.654832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:12.655745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:12.656030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:12.656308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] PATH_INFO: `/v3/users/99d50bb0feb049b39233f3ec8111bafc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:12.657538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d50bb0feb049b39233f3ec8111bafc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:12.659463 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:12.825252 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d50bb0feb049b39233f3ec8111bafc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:12.825873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d50bb0feb049b39233f3ec8111bafc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:12.826480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d50bb0feb049b39233f3ec8111bafc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:12.838853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d50bb0feb049b39233f3ec8111bafc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:12.845809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d50bb0feb049b39233f3ec8111bafc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:12.919011 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1261/2546] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:40:12 2022] DELETE /identity/v3/users/99d50bb0feb049b39233f3ec8111bafc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:40:12.925150 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:12.925666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:12.925802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:12.945476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:40:12.946696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:13.006255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1286/2547] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:40:13.016114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:13.017572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:13.076735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1e98-b7dc-431a-bda0-422349747013 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:13.080292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:13.080968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:13.081253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:13.081529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:13.091544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:13.093015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:13.103320 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1262/2548] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:13.504103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:13.505582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:13.519079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ed95-a76a-4821-a4c0-59ad789e53d9 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:13.524737 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:13.525610 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:13.525884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:13.526154 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] PATH_INFO: `/v3/projects/3d49b818ed404261bbb65e0c496ec17e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:13.527347 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d49b818ed404261bbb65e0c496ec17e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:13.529741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:13.638927 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d49b818ed404261bbb65e0c496ec17e', 'request_id': 'req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:13.645037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d49b818ed404261bbb65e0c496ec17e', 'request_id': 'req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:13.722970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d49b818ed404261bbb65e0c496ec17e', 'request_id': 'req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:13.733838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] The token cache is being invalidate because project 3d49b818ed404261bbb65e0c496ec17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:40:13.734125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:13.734753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-64ec3cfb-eef1-4dee-8f1e-5a8a73e5784d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:13.736296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1287/2549] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:40:13 2022] DELETE /identity/v3/projects/3d49b818ed404261bbb65e0c496ec17e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:40:23.098106 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:23.730654 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:24.550539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:24.550539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:24.563782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17380ac-55e3-4549-b6e2-062c9dce5306 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:24.619055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:24.619850 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:24.620129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:24.620404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] PATH_INFO: `/v3/users/2498e939cf284514b7fedc50e4bc7544` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:24.621615 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2498e939cf284514b7fedc50e4bc7544)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:24.623552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:24.860890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2498e939cf284514b7fedc50e4bc7544'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:24.861569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2498e939cf284514b7fedc50e4bc7544'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:24.862227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2498e939cf284514b7fedc50e4bc7544'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:24.874401 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2498e939cf284514b7fedc50e4bc7544'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:24.882044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2498e939cf284514b7fedc50e4bc7544'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:24.981744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1263/2550] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:40:24 2022] DELETE /identity/v3/users/2498e939cf284514b7fedc50e4bc7544 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:40:24.986200 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:24.986673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:24.986792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:25.004714 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:40:25.007420 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:25.066303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1288/2551] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:40:25.076048 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:25.077442 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:25.136647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e3da8-1a3e-4a50-af29-1964a8d4ac31 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:25.140422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:25.141097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:25.141377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:25.141651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:25.150461 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:25.151886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e946e51-1838-49c0-baa4-b44601fe724f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:25.161469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1264/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:25.620175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:25.621754 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:25.634771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ee7d9-8f38-40f7-a5aa-b4ce264d7768 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:25.639877 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:25.643597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:25.643597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:25.643597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] PATH_INFO: `/v3/projects/6607f0040eeb490cae2591bca38c359e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:25.643597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6607f0040eeb490cae2591bca38c359e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:25.644625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:25.779162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6607f0040eeb490cae2591bca38c359e', 'request_id': 'req-11d697c0-4389-4558-8241-168f2cec65a2'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:25.785431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6607f0040eeb490cae2591bca38c359e', 'request_id': 'req-11d697c0-4389-4558-8241-168f2cec65a2'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:25.918253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6607f0040eeb490cae2591bca38c359e', 'request_id': 'req-11d697c0-4389-4558-8241-168f2cec65a2'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:25.929613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] The token cache is being invalidate because project 6607f0040eeb490cae2591bca38c359e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:40:25.929899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:25.930538 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-11d697c0-4389-4558-8241-168f2cec65a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:40:25.932117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1289/2553] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:40:25 2022] DELETE /identity/v3/projects/6607f0040eeb490cae2591bca38c359e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:40:25.937192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:25.937704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:25.937821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:25.958454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:40:25.959789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:25.979722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:26.024881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1265/2554] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:40:26.032783 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.033258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.033367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.051625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:40:26.052848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:26.061178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1290/2555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:40:26.066330 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.076068 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8540-2b84-4608-b589-443cc4851fd0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.080888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.081586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.081876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.082188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.083044 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:40:26.083734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.086766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.103194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1266/2556] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:40:26.107725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.117684 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc7015-c157-40ad-95fd-4833252cb992 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.122637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.123424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.123712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.123987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.124711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.126667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.218099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1291/2557] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:40:26 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:40:26.222417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.232591 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd341-e320-4847-b741-0fb9cb8f9ac7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.289482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.290148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.290428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.290699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.291382 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.293345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.382903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1267/2558] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:40:26 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:40:26.387014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.397989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8ddd-1ecc-459d-a91a-d5bdf30fc1c2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.402825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.403509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.403903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.404205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.404990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.406595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.417091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1292/2559] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:40:26.422792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.433303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468ff3-33a1-4fe6-86d9-789bed999c23 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.437940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.438624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.438908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.439181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.439902 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.443467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbcd33-a5f6-447e-bec0-6dafe89338e0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.455968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1268/2560] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:40:26.463316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.473315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda06ad-388d-4606-ac0d-92a242edeb5b admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.478145 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.479031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.479315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.479593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] PATH_INFO: `/v3/projects/c66bbb0414b0454da0bc94bce7e4a4a7/users/def1238b09db46cfbee4ae255cb7f751/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.495365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66bbb0414b0454da0bc94bce7e4a4a7, user_id=def1238b09db46cfbee4ae255cb7f751, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.498073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.609854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1293/2561] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:40:26 2022] PUT /identity/v3/projects/c66bbb0414b0454da0bc94bce7e4a4a7/users/def1238b09db46cfbee4ae255cb7f751/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:40:26.620672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.626577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.626577 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.649047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] MFA Rules not processed for user `def1238b09db46cfbee4ae255cb7f751`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:40:26.650307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:26.715326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1269/2562] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:40:26.727663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:26.729498 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:26.751745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:26.785469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79eb29-d480-41fb-86a1-26e0512e5968 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:26.789667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:26.790307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:26.790595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:26.790873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:26.799086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:26.800540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:26.810277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1294/2563] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:35.802081 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:35.803546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:35.824572 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:35.862151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb102f5-929c-4763-8ce2-7b3da9b532a6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:35.865738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:35.866380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:35.867263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:35.868951 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:35.869764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:35.941250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:35.942743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:35.953860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1270/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:36.904074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=17 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:37.139029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:37.150581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d25b-f4e9-4150-b472-637f15371cad service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:37.154634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:37.155295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:37.155577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:37.155852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:37.157706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:37.173375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:37.174916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:37.186867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1295/2565] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:46.636126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=46 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:47.181820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:48.101604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:40:48.107952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78412d-181c-4092-9e07-1b9a833695a7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:40:48.111566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:40:48.112200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:40:48.112512 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:40:48.112828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:40:48.114639 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:40:48.178869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:40:48.181131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:40:48.190696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1271/2566] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:40:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:40:58.186467 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=30 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:12.033380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:12.034798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:12.049084 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4708a-6964-4c0e-a888-c54eabd2c327 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:12.054642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:12.055286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:12.055572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:12.055849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:12.057629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:12.117223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:12.120013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:12.132792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1296/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:20.417534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:20.419066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:20.434569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3771-3e46-451f-a980-592528826d58 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:20.440134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:20.440814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:20.441104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:20.441380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:20.443097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:20.502356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:20.503954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:20.513548 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1272/2568] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:22.127541 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=28 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:22.331937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:22.344378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837a4f-e321-4ca8-a022-90debf5ddad3 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:22.348134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:22.348964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:22.349415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:22.350004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:22.352014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:22.362914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:22.364356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270cdd-53d6-4ab3-baf3-bdea2bcf9a77 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:22.374151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1297/2569] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:24.924978 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:24.986699 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab9a70-e303-43ed-adab-b470a06f143a service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:24.991544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:24.992441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:24.992779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:24.993055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] PATH_INFO: `/v3/users/def1238b09db46cfbee4ae255cb7f751` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:24.994235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def1238b09db46cfbee4ae255cb7f751)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:24.996253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:25.270351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def1238b09db46cfbee4ae255cb7f751'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:25.271036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def1238b09db46cfbee4ae255cb7f751'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:25.271653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def1238b09db46cfbee4ae255cb7f751'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:25.284357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def1238b09db46cfbee4ae255cb7f751'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:25.291156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def1238b09db46cfbee4ae255cb7f751'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:25.406210 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1273/2570] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:41:24 2022] DELETE /identity/v3/users/def1238b09db46cfbee4ae255cb7f751 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:41:25.410874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:25.411378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:25.411482 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:25.429530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:25.430729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:25.489129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1298/2571] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:25.499457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:25.500904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:25.521712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:25.559570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bad61-fe4a-472a-8737-a3fd20c37cd8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:25.563289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:25.563928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:25.564218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:25.564514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:25.573622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:25.575622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d284fe-66f4-45f6-9ecc-f591c07d9999 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:25.585142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1274/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:26.058386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:26.060531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:26.072198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee5131-285d-4f64-941a-c3d69bf52728 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:26.077721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:26.078584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.078867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.079141 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] PATH_INFO: `/v3/projects/c66bbb0414b0454da0bc94bce7e4a4a7` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.080364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66bbb0414b0454da0bc94bce7e4a4a7)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:26.082301 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:26.291946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66bbb0414b0454da0bc94bce7e4a4a7', 'request_id': 'req-def3e733-3a63-4c9e-ac6a-c3d5798999ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:26.298663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66bbb0414b0454da0bc94bce7e4a4a7', 'request_id': 'req-def3e733-3a63-4c9e-ac6a-c3d5798999ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:26.462844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66bbb0414b0454da0bc94bce7e4a4a7', 'request_id': 'req-def3e733-3a63-4c9e-ac6a-c3d5798999ae'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:26.474501 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] The token cache is being invalidate because project c66bbb0414b0454da0bc94bce7e4a4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:41:26.474795 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:26.475427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-def3e733-3a63-4c9e-ac6a-c3d5798999ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:41:26.477048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1299/2573] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:41:26 2022] DELETE /identity/v3/projects/c66bbb0414b0454da0bc94bce7e4a4a7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:41:26.482974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.483429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.483551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.502282 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:26.503473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:26.562683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1275/2574] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:26.570435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.570668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.570946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.589014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:26.590218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:26.598248 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1300/2575] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:26.602436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:26.612952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b7a06-73bb-4772-bbf2-aeb54441a3be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:26.617648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:26.618303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.618587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.618865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.619586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:41:26.619939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:26.621574 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:26.633668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1276/2576] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:41:26.637900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:26.647323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a23b9-8ad1-49cb-98d7-8c07f68ff34d None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:26.652035 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:26.652747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.653528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.653804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.654496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:26.656603 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:26.772494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1301/2577] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:41:26 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:41:26.776517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:26.787162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb36b-af96-4941-a0b4-3a596959139e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:26.843029 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:26.843650 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:26.843957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:26.844236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:26.844975 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:26.846946 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:26.994449 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1277/2578] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:41:26 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:41:26.999004 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:27.009410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37407-124d-43e0-9d9a-3dbd29ac07f7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:27.014960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:27.015691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:27.015923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:27.016197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:27.016962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:27.018559 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:27.030074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1302/2579] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:41:27.034007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:27.044037 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1de6a-73dd-4777-ba10-efa8bf54fa0e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:27.048665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:27.049322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:27.049609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:27.049890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:27.050618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:27.052219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10464c3a-5809-4a42-84ab-27f85c8b7e2d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:27.062387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1278/2580] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:41:27.066569 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:27.077364 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8accd1-dc2b-4a36-a9a9-34253c6d70d5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:27.081962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:27.082852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:27.083134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:27.083409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] PATH_INFO: `/v3/projects/8dfca5eaef124207812c35441a729493/users/f4329d95a2764fc58b286f4e1f451b88/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:27.098317 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfca5eaef124207812c35441a729493, user_id=f4329d95a2764fc58b286f4e1f451b88, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:27.100941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:27.179793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1303/2581] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:41:27 2022] PUT /identity/v3/projects/8dfca5eaef124207812c35441a729493/users/f4329d95a2764fc58b286f4e1f451b88/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:41:27.184874 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b01ab-1c49-44d2-8467-a156700690f0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:27.185167 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b01ab-1c49-44d2-8467-a156700690f0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:27.185448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b01ab-1c49-44d2-8467-a156700690f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:27.203360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e69b01ab-1c49-44d2-8467-a156700690f0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:27.204594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e69b01ab-1c49-44d2-8467-a156700690f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:27.224386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:27.260727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1279/2582] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:27.270972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:27.272705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:27.283263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:27.330064 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3265e-c3cb-409e-ab83-42de5b302d35 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:27.334294 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:27.334945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:27.335226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:27.335506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:27.344982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:27.351715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:27.355741 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1304/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:28.770862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b448b0-f8e7-4a4e-bc9f-b39093254f4b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:28.771394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b448b0-f8e7-4a4e-bc9f-b39093254f4b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:28.771564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b448b0-f8e7-4a4e-bc9f-b39093254f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:28.800475 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-39b448b0-f8e7-4a4e-bc9f-b39093254f4b None None] MFA Rules not processed for user `f4329d95a2764fc58b286f4e1f451b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:28.801804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39b448b0-f8e7-4a4e-bc9f-b39093254f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:28.866702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1280/2584] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:28.877862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:28.879237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:28.937491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104843-3478-4410-98f7-d02ceefac7be service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:28.941155 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:28.941810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:28.942092 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:28.942369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:28.950685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:28.952116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:28.960863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1305/2585] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:30.824506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:30.825711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:30.825854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:30.843231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] MFA Rules not processed for user `f4329d95a2764fc58b286f4e1f451b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:30.845042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:30.851862 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1281/2586] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:31.156597 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:31.166185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59d52-e4d9-4253-8e1d-1a394b99284c service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:31.169878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:31.170525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:31.170810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:31.171088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:31.172937 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:31.182435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:31.183869 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2648-7470-4432-8d3c-e7d7f2eeadc8 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:31.192343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1306/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:31.666890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:31.669686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:31.739806 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad77f-f7ea-42a5-ad01-4948e58d382b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:31.744879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:31.745537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:31.745823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:31.746103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:31.748531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:31.760482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:31.762088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:31.772386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1282/2588] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:38.057762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:38.058295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:38.058412 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:38.077850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] MFA Rules not processed for user `fb1df28c175c40b7a06d1f94ba780d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:41:38.079500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:38.136320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1307/2589] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:41:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:41:39.043797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:39.046478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:39.115306 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:39.147047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8721af-4925-484a-851d-3727399d0a45 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:39.152764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:39.154228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:39.154637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:39.154990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:39.156988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:39.169565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:39.171177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ef5e-75f1-4ee0-8b4e-b05b7efdb38f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:39.182600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1283/2590] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:46.854414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:41:46.855988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:46.873945 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624591f5-b8ce-415a-bc91-a3af6165b618 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:41:46.879535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:41:46.881969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:41:46.881969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:41:46.881969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:41:46.882547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:41:46.895435 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:41:46.898802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:41:46.912099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1308/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:41:49.314819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=16 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:56.906961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=86 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:31.725772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8bee-3312-4f02-9f81-74813e9ffd2a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:42:31.726284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8bee-3312-4f02-9f81-74813e9ffd2a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:42:31.726378 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8bee-3312-4f02-9f81-74813e9ffd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:42:31.744245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-25bd8bee-3312-4f02-9f81-74813e9ffd2a None None] MFA Rules not processed for user `94d49cbc2d5d458881d3c2a5880f9109`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:42:31.745482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25bd8bee-3312-4f02-9f81-74813e9ffd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:42:31.800499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1284/2592] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:42:41.793129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:00.269252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:00.281165 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5842c2-77c3-4d0c-94fb-e591600fbda0 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:00.286354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:00.287017 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:00.287304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:00.287584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:00.289388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:00.301807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:00.303389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795ee6-645b-4415-8682-1dedefb4ebae service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:00.314424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1309/2593] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:10.309421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:16.516323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f925d-7437-425b-b223-156a463ac418 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:16.516913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f925d-7437-425b-b223-156a463ac418 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:16.516913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f925d-7437-425b-b223-156a463ac418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:16.534809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-999f925d-7437-425b-b223-156a463ac418 None None] MFA Rules not processed for user `f4329d95a2764fc58b286f4e1f451b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:16.536056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-999f925d-7437-425b-b223-156a463ac418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:16.543064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1285/2594] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:43:21.878512 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbb88-68c6-49e0-8558-8c040be434da None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:21.879115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbb88-68c6-49e0-8558-8c040be434da None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:21.879115 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbb88-68c6-49e0-8558-8c040be434da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:21.901304 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4d6dbb88-68c6-49e0-8558-8c040be434da None None] MFA Rules not processed for user `af32d2a5a83546699f5e2caa3def410d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:21.905315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4d6dbb88-68c6-49e0-8558-8c040be434da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:21.974852 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1310/2595] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:43:26.529434 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:31.967014 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=25 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:40.749675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f925d-7437-425b-b223-156a463ac418 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:40.762035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f925d-7437-425b-b223-156a463ac418 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:40.767126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:40.768021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:40.768789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:40.769364 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:40.771340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:40.782459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:40.783897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f513b7-ffbe-431a-94d6-b15d64133468 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:40.792194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1286/2596] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:41.246466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432081-db6f-4e96-88ea-ae7776ed2a71 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.246466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432081-db6f-4e96-88ea-ae7776ed2a71 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.246466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432081-db6f-4e96-88ea-ae7776ed2a71 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.248602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1311/2597] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:43:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:41.255660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f883f-193d-4804-98cd-1a6fd648771c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.256215 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f883f-193d-4804-98cd-1a6fd648771c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.256632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f883f-193d-4804-98cd-1a6fd648771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.283961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d93f883f-193d-4804-98cd-1a6fd648771c None None] MFA Rules not processed for user `8f74aa6096fb4f1aa6f239f39b670712`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:41.285638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d93f883f-193d-4804-98cd-1a6fd648771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:41.292988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1287/2598] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:41.306289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c432081-db6f-4e96-88ea-ae7776ed2a71 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:41.318666 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c432081-db6f-4e96-88ea-ae7776ed2a71 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:41.322353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:41.323021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.323302 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.323574 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.331433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:41.335369 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b40c4e-c483-48b9-85cf-e698c8ac29d7 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:41.340731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1312/2599] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:41.428214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fb9d-0c5f-41bd-b233-0334262b85d4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.428628 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fb9d-0c5f-41bd-b233-0334262b85d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.428914 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fb9d-0c5f-41bd-b233-0334262b85d4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.430289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1288/2600] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:41.435269 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.435554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.435837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.475506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:41.476810 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:41.486867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1313/2601] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:41.497522 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fb9d-0c5f-41bd-b233-0334262b85d4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:41.509825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fb9d-0c5f-41bd-b233-0334262b85d4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:41.513851 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:41.514491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:41.514766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:41.515034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:41.527513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:41.529556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:41.541559 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1289/2602] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:43.398904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:43.400334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:43.413009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4cbb3-ee5a-4eb6-8c18-3d7a3b793349 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:43.416724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:43.417368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:43.417644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:43.417918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:43.419742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:43.439923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:43.441411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:43.451845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1314/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:47.381783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:47.393145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52bbf6-e0e2-44b4-86a0-abb738929c8f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:47.398212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:47.398858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:47.399141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:47.399420 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:47.401414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:47.413787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:47.415410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:47.426108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1290/2604] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:47.547536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:47.549372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:47.562410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3d8-c00a-4133-b54e-0fe9442a2313 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:47.567622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:47.568518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:47.568804 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:47.569079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] PATH_INFO: `/v3/users/fb1df28c175c40b7a06d1f94ba780d28` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:47.570277 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1df28c175c40b7a06d1f94ba780d28)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:47.572205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:47.599870 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:47.611030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb470d23-1d08-441c-9a61-e6d72e37b659 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:47.624760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:47.624760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:47.624760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:47.624760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:47.625739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:47.632083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:47.633693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:47.643930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1291/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:43:47.894679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1df28c175c40b7a06d1f94ba780d28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:47.895312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1df28c175c40b7a06d1f94ba780d28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:47.895917 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1df28c175c40b7a06d1f94ba780d28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:47.909491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1df28c175c40b7a06d1f94ba780d28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:47.916406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-89000d85-0997-442e-97d2-6ab834a2a638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1df28c175c40b7a06d1f94ba780d28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.003169 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1315/2606] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:43:47 2022] DELETE /identity/v3/users/fb1df28c175c40b7a06d1f94ba780d28 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:43:48.302965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:48.325635 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219028d-dbec-4a4b-8a81-4ac95ff5d5db service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:48.390034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:48.393021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.393502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.394509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] PATH_INFO: `/v3/projects/ae365d6da0e846baa0056cb67ac716d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.396238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae365d6da0e846baa0056cb67ac716d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:48.398362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:48.558338 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae365d6da0e846baa0056cb67ac716d6', 'request_id': 'req-3bcf9985-ea00-4c75-9224-43ecde30e1db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.565409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae365d6da0e846baa0056cb67ac716d6', 'request_id': 'req-3bcf9985-ea00-4c75-9224-43ecde30e1db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.570991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae365d6da0e846baa0056cb67ac716d6', 'request_id': 'req-3bcf9985-ea00-4c75-9224-43ecde30e1db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.666227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] The token cache is being invalidate because project ae365d6da0e846baa0056cb67ac716d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:43:48.666426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.667084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3bcf9985-ea00-4c75-9224-43ecde30e1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:43:48.668723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1292/2607] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:43:48 2022] DELETE /identity/v3/projects/ae365d6da0e846baa0056cb67ac716d6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:43:48.673990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a23c-8d18-4660-a21d-00354139461e None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.674509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a23c-8d18-4660-a21d-00354139461e None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.674620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a23c-8d18-4660-a21d-00354139461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.692896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8946a23c-8d18-4660-a21d-00354139461e None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:48.694100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8946a23c-8d18-4660-a21d-00354139461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:48.752875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1316/2608] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:48.760661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555176-7eef-4458-88af-cd5974093b72 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.760952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555176-7eef-4458-88af-cd5974093b72 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.761230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555176-7eef-4458-88af-cd5974093b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.780852 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-45555176-7eef-4458-88af-cd5974093b72 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:48.782077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45555176-7eef-4458-88af-cd5974093b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:48.792967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1293/2609] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:43:48.799620 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a23c-8d18-4660-a21d-00354139461e None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:48.808901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a23c-8d18-4660-a21d-00354139461e None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:48.814549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:48.815212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.815493 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.815769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.816517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:43:48.816827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:48.818409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:48.830156 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1317/2610] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:43:48.834658 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555176-7eef-4458-88af-cd5974093b72 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:48.843920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555176-7eef-4458-88af-cd5974093b72 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:48.848645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:48.849326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.849626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.849886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.850583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:48.852505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:48.876132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:48.986457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1294/2611] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:43:48 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:43:48.990586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:49.002586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a8d00-3b7c-4301-bd5a-f83c7f78f066 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:49.017193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:49.076052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:49.076762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.077047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.077353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.078093 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:49.080181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:49.267340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1318/2612] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:43:48 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:43:49.271651 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:49.283316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a09560-d1ad-4846-b5bb-546294fd5782 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:49.287864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:49.288546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.288826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.289095 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.289817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:49.291459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:49.302165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1295/2613] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:43:49.306222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:49.316376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fa689-7cbd-4883-b75f-303a74b7f27d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:49.321105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:49.321787 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.322073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.322357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.323091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:49.324724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449bcdf-e815-44c6-a1d5-5220e9fbf3a1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:49.334892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1319/2614] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:43:49.339119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:49.350223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e2612-07c2-428f-bc53-ac7cd15e21c8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:49.355015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:49.355899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.356177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.356448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] PATH_INFO: `/v3/projects/21bdae6c05954d4aa06501fec56a19a2/users/1885c809018b4f0890028ba202aa415b/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.372408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bdae6c05954d4aa06501fec56a19a2, user_id=1885c809018b4f0890028ba202aa415b, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:49.375709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:49.513771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1296/2615] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:43:49 2022] PUT /identity/v3/projects/21bdae6c05954d4aa06501fec56a19a2/users/1885c809018b4f0890028ba202aa415b/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:43:49.517236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43ff8-ca55-47cb-a0ce-4fc2cfa068d9 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.517531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43ff8-ca55-47cb-a0ce-4fc2cfa068d9 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.517884 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43ff8-ca55-47cb-a0ce-4fc2cfa068d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.536447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-eef43ff8-ca55-47cb-a0ce-4fc2cfa068d9 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:49.537712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-eef43ff8-ca55-47cb-a0ce-4fc2cfa068d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:49.598360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1320/2616] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:43:49.608169 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:49.610460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:49.670009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f9526-7c69-45cc-a6cb-cadfb397134e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:49.673939 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:49.674587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:49.674866 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:49.675139 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:49.684249 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:49.685715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:49.695761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1297/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:56.138053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccff1e-aecf-48f6-a587-e1144db9a3fe None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:56.138629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccff1e-aecf-48f6-a587-e1144db9a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:56.138629 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccff1e-aecf-48f6-a587-e1144db9a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:56.171835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-1cccff1e-aecf-48f6-a587-e1144db9a3fe None None] MFA Rules not processed for user `1885c809018b4f0890028ba202aa415b`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:56.173662 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1cccff1e-aecf-48f6-a587-e1144db9a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:56.264061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1321/2618] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:56.280528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:56.287737 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:56.370730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d860-4fc4-4cf4-9395-7e2139ad4f4e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:56.378645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:56.378897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:56.379179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:56.379555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:56.389158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:56.391753 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:56.401743 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1298/2619] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:59.584618 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:59.585536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:59.586033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:59.608413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] MFA Rules not processed for user `1885c809018b4f0890028ba202aa415b`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:59.611638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:59.620471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1322/2620] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:06.397071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=2,keystone:SELECT=77 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:09.600158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:48.734829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:48.736459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:48.750200 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fec36-367b-495e-9dfd-375f9756560b service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:48.755840 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:48.756745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:48.757030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:48.757956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] PATH_INFO: `/v3/users/f4329d95a2764fc58b286f4e1f451b88` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:48.758513 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4329d95a2764fc58b286f4e1f451b88)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:48.760505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:48.955377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4329d95a2764fc58b286f4e1f451b88'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:48.956025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4329d95a2764fc58b286f4e1f451b88'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:48.956722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4329d95a2764fc58b286f4e1f451b88'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:48.968074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4329d95a2764fc58b286f4e1f451b88'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:48.975056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4329d95a2764fc58b286f4e1f451b88'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.096079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1299/2621] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:44:48 2022] DELETE /identity/v3/users/f4329d95a2764fc58b286f4e1f451b88 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:44:49.424075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:49.436433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4d46c-d57c-48a7-9d8c-6567136ac265 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:49.501802 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:49.502691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:49.502971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:49.503239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] PATH_INFO: `/v3/projects/8dfca5eaef124207812c35441a729493` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:49.504432 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfca5eaef124207812c35441a729493)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:49.506360 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:49.696436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfca5eaef124207812c35441a729493', 'request_id': 'req-87847d7a-b818-4612-ae37-bcecfb5fe9de'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.702533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfca5eaef124207812c35441a729493', 'request_id': 'req-87847d7a-b818-4612-ae37-bcecfb5fe9de'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.833114 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfca5eaef124207812c35441a729493', 'request_id': 'req-87847d7a-b818-4612-ae37-bcecfb5fe9de'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.844089 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] The token cache is being invalidate because project 8dfca5eaef124207812c35441a729493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:44:49.844416 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.845125 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-87847d7a-b818-4612-ae37-bcecfb5fe9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:44:49.846680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1323/2622] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:44:49 2022] DELETE /identity/v3/projects/8dfca5eaef124207812c35441a729493 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:44:59.092042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:59.841026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:19.166143 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:19.167526 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:19.225031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6ea8-afbe-445a-a9b3-bb6a818dd2e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:19.273274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:19.273928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:19.274212 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:19.274487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:19.276298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:19.336689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:19.338543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:19.348480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1300/2623] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:29.343519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=68 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:31.557132 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:31.557630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:31.557630 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:31.576481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] MFA Rules not processed for user `94d49cbc2d5d458881d3c2a5880f9109`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:31.577755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:31.584875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1324/2624] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:45:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:35.999085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:36.001078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:36.062820 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44664a-2129-4128-bb52-bebd1625482e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:36.067117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:36.067766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:36.068045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:36.068318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:36.070240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:36.141659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:36.143146 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:36.156809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1301/2625] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:38.512279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:38.522663 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b06b8-1b48-4e42-b1fc-fb30e493487c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:38.526429 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:38.527074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:38.527431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:38.527843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:38.529822 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:38.544665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:38.550131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:38.557607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1325/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:46.150327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=54 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:48.553358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=9 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:52.351251 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:52.352692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:52.363243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2c347-1c03-4a3a-af4a-5a770801cf30 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:52.367172 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:52.367801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:52.368227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:52.368517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:52.370271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:52.430568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:52.432245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:52.441598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1302/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:45:54.274616 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:54.283386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d360-0624-49ca-9ef1-980f6019420a service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:54.288091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:54.288779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:54.289060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:54.289331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:54.291539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:54.375318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:54.376913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:54.390772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1326/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:01.677279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:01.687561 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6b23-9523-422f-a292-09227b4efbac service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:01.694927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:01.694927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:01.694927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:01.694927 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:01.695684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:01.781108 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:01.782576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:01.794402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1303/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:04.384826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=30 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:08.207290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:08.217465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a58d6-7b13-4961-bece-61cda26af1f3 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:08.221370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:08.222020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:08.222500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:08.222935 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:08.225906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:08.240433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:08.243043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:08.253308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1327/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:09.967849 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:09.969360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:10.081854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843e50-50e3-4402-86de-8a3f5da67c11 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:10.088689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:10.089445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.089730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.090008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.092708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:10.109311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:10.111633 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:10.125788 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1304/2631] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:10.139395 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:10.141715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:10.167529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07a59-3927-4d2f-bda5-b9378f5dce15 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:10.173489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:10.175411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.175846 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.176271 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] PATH_INFO: `/v3/users/8c2e294be3d7494b80f994c7f58475c8` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.178073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e294be3d7494b80f994c7f58475c8)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:10.180283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:10.413838 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e294be3d7494b80f994c7f58475c8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:10.414502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e294be3d7494b80f994c7f58475c8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:10.415153 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e294be3d7494b80f994c7f58475c8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:10.427257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e294be3d7494b80f994c7f58475c8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:10.436593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e294be3d7494b80f994c7f58475c8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:10.540091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1328/2632] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:46:10 2022] DELETE /identity/v3/users/8c2e294be3d7494b80f994c7f58475c8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:10.839915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:10.856810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257075-6171-4d2a-830a-7b49797776cf service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:10.878553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:10.918734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:10.919636 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.919915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.920188 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] PATH_INFO: `/v3/projects/86160ae3ef564baa92ba603c13d0bf5b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.921399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86160ae3ef564baa92ba603c13d0bf5b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:10.923468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:11.052672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86160ae3ef564baa92ba603c13d0bf5b', 'request_id': 'req-07ced4f7-7966-471b-afba-0e4b8e2cd283'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.059540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86160ae3ef564baa92ba603c13d0bf5b', 'request_id': 'req-07ced4f7-7966-471b-afba-0e4b8e2cd283'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.065023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86160ae3ef564baa92ba603c13d0bf5b', 'request_id': 'req-07ced4f7-7966-471b-afba-0e4b8e2cd283'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.147908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] The token cache is being invalidate because project 86160ae3ef564baa92ba603c13d0bf5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:46:11.148823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.149845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.151506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1305/2633] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:46:10 2022] DELETE /identity/v3/projects/86160ae3ef564baa92ba603c13d0bf5b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:11.155499 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:11.157003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:11.171546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148086e-0f81-444d-a785-cc27e57a7cc4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:11.238656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:11.239554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:11.239858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:11.240142 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] PATH_INFO: `/v3/users/49a1beb869f44b8484811b7eb3e6f670` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:11.241388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a1beb869f44b8484811b7eb3e6f670)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:11.243308 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:11.480519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a1beb869f44b8484811b7eb3e6f670'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.481270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a1beb869f44b8484811b7eb3e6f670'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.481961 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a1beb869f44b8484811b7eb3e6f670'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.496555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:11.500091 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a1beb869f44b8484811b7eb3e6f670'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.509097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a1beb869f44b8484811b7eb3e6f670'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:11.647978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1329/2634] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:46:11 2022] DELETE /identity/v3/users/49a1beb869f44b8484811b7eb3e6f670 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:11.943363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:11.946436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:11.964897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced4f7-7966-471b-afba-0e4b8e2cd283 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:12.054579 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:12.055722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:12.056010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:12.056289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] PATH_INFO: `/v3/projects/559225b3c9014690a5ecd138e3e2a75c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:12.057550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=559225b3c9014690a5ecd138e3e2a75c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:12.059921 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:12.229101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559225b3c9014690a5ecd138e3e2a75c', 'request_id': 'req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.235707 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559225b3c9014690a5ecd138e3e2a75c', 'request_id': 'req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.236999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:12.243159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559225b3c9014690a5ecd138e3e2a75c', 'request_id': 'req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.414637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] The token cache is being invalidate because project 559225b3c9014690a5ecd138e3e2a75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:46:12.416578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.416578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.417609 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1306/2635] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:46:11 2022] DELETE /identity/v3/projects/559225b3c9014690a5ecd138e3e2a75c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:12.563194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:12.565515 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:12.581344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19241-8774-401e-89db-88466b90bbfe admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:12.652947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:12.653943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:12.654350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:12.654991 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] PATH_INFO: `/v3/users/af32d2a5a83546699f5e2caa3def410d` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:12.674176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af32d2a5a83546699f5e2caa3def410d)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:12.676366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:12.908350 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af32d2a5a83546699f5e2caa3def410d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.909085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af32d2a5a83546699f5e2caa3def410d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.909696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af32d2a5a83546699f5e2caa3def410d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.921815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af32d2a5a83546699f5e2caa3def410d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.929028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-a7e00e23-3f2e-4cb6-a428-028a91a5262b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af32d2a5a83546699f5e2caa3def410d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:12.989362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1330/2636] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:46:12 2022] DELETE /identity/v3/users/af32d2a5a83546699f5e2caa3def410d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:13.229510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:13.234525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:13.246814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09f787-0f8e-4e84-b233-a4dd0f4bc8fd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:13.327439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:13.329386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.329675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.329955 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] PATH_INFO: `/v3/projects/5dacb56069b74ca6b04d4710a9c4bc96` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.342334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dacb56069b74ca6b04d4710a9c4bc96)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:13.343911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:13.451288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dacb56069b74ca6b04d4710a9c4bc96', 'request_id': 'req-b4a9b396-26fb-41b4-a509-9338dccd9b8e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:13.457873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dacb56069b74ca6b04d4710a9c4bc96', 'request_id': 'req-b4a9b396-26fb-41b4-a509-9338dccd9b8e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:13.464099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dacb56069b74ca6b04d4710a9c4bc96', 'request_id': 'req-b4a9b396-26fb-41b4-a509-9338dccd9b8e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:13.541969 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] The token cache is being invalidate because project 5dacb56069b74ca6b04d4710a9c4bc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:46:13.542182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:13.542796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b4a9b396-26fb-41b4-a509-9338dccd9b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:46:13.544348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1307/2637] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:46:13 2022] DELETE /identity/v3/projects/5dacb56069b74ca6b04d4710a9c4bc96 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:46:13.549581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.549900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.550180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.569015 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:13.571209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:13.617462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:13.635513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1331/2638] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:13.644013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.644301 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.644624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.664569 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:13.665877 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:13.674497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1308/2639] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:13.679577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:13.689592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023abcc-e80e-4bea-9ab7-781b4fcd5224 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:13.694820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:13.695477 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.695758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.696037 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.696797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:46:13.697103 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:13.700010 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106f3e6-3a09-421a-8445-a54b88351ba3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:13.710834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1332/2640] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:46:13.715250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:13.724379 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de269c09-66a2-4486-8d93-5a4732a01572 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:13.729524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:13.734411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.734411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.734411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.734411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:13.734411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:13.779475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.779763 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.780043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.799731 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:13.800865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:13.845495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1309/2641] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:46:13 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:46:13.846622 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:13.860173 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1333/2642] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:46:13.892164 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:13.917997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d3ec-da08-4b86-ae90-56a4cc68dac7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:13.922781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:13.923458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:13.923739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:13.924050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:13.924747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:13.926680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.000003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:14.001455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:14.028570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1310/2643] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:46:13 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:46:14.032663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:14.043883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ee0c9-7a6c-4a47-accc-31d182e4ba96 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:14.048991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:14.049739 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.050075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.050361 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.051093 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:14.052756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.066828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1311/2644] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:46:14.071546 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:14.081128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfc2e-c018-4559-9595-e8b9d5c40748 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:14.083793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31b8d-15de-499b-b737-7dae0dee8770 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:14.086456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:14.087112 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.087397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.087668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.088435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:14.090087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.101394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1312/2645] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:46:14.105690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:14.117473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76372-1648-40f8-91bb-2d4429b0f47b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:14.121525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:14.122439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.123433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.123433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] PATH_INFO: `/v3/projects/d17a97aafb584c31a3cc404634d95885/users/4779e97de469458792d574e607fd8a1f/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.138967 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a97aafb584c31a3cc404634d95885, user_id=4779e97de469458792d574e607fd8a1f, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:14.141869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.154419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:14.155082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.155361 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.155632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.177734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:14.213444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:14.215062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161009-01d0-4aa5-9a07-d27d40027406 service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.223279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1334/2646] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:46:14.274273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1313/2647] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:46:14 2022] PUT /identity/v3/projects/d17a97aafb584c31a3cc404634d95885/users/4779e97de469458792d574e607fd8a1f/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:46:14.279160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd86a-e4cf-45eb-85f1-fb4b840a7f88 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.279550 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd86a-e4cf-45eb-85f1-fb4b840a7f88 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.279850 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd86a-e4cf-45eb-85f1-fb4b840a7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.301303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8f3bd86a-e4cf-45eb-85f1-fb4b840a7f88 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:14.302545 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8f3bd86a-e4cf-45eb-85f1-fb4b840a7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:14.377530 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1335/2648] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:14.390219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:14.392543 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:14.469527 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83136-2c6d-4b54-87ed-5844942156f7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:14.473552 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:14.474313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:14.474698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:14.475683 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:14.485757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:14.487285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:14.500032 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1314/2649] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:21.830830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a516-106a-465e-b2e3-1b23a4490b62 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:21.830830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a516-106a-465e-b2e3-1b23a4490b62 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:21.830830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a516-106a-465e-b2e3-1b23a4490b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:21.830830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-eca4a516-106a-465e-b2e3-1b23a4490b62 None None] MFA Rules not processed for user `4779e97de469458792d574e607fd8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:21.830830 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-eca4a516-106a-465e-b2e3-1b23a4490b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:21.893199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1336/2650] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:21.907883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:21.909476 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:21.997481 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188a301-6ebe-4d47-ad39-e01df9cba285 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:22.003480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:22.004224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:22.004537 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:22.004825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:22.016036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:22.017817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:22.027828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1315/2651] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:46:25.552247 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77ffb8-9808-476d-8b75-c24fa2806275 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:25.555534 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77ffb8-9808-476d-8b75-c24fa2806275 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:25.557859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77ffb8-9808-476d-8b75-c24fa2806275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:25.578104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0e77ffb8-9808-476d-8b75-c24fa2806275 None None] MFA Rules not processed for user `4779e97de469458792d574e607fd8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:25.579372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0e77ffb8-9808-476d-8b75-c24fa2806275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:25.588300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1337/2652] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:28.637460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:28.657056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570d5de-f1cc-4473-bc94-aa2e7cbfeb66 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:28.660798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:28.665916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:28.665916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:28.665916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:28.665916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:28.670881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:28.675676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:28.676879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c80b9-cf65-4715-9dc2-b17f166937b9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:28.686632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1316/2653] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:33.709880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:33.710472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:33.711116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] PATH_INFO: `/` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:33.712990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1338/2654] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 08:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:33.718845 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6716-868d-4e38-857b-798973a8e96a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:33.719308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6716-868d-4e38-857b-798973a8e96a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:33.719528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c6716-868d-4e38-857b-798973a8e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:33.738218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-230c6716-868d-4e38-857b-798973a8e96a None None] MFA Rules not processed for user `d125909b383a44b49e94715bde34866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:33.739428 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-230c6716-868d-4e38-857b-798973a8e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:33.748910 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1317/2655] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 08:46:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:33.760368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:33.762029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:33.815463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:33.821726 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a2bdb-c9f9-4515-bbe6-3fb1e9460bd2 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:33.825362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:33.826007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:33.826287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:33.826558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:33.837908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:33.845975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2773d-ce6b-48e9-a63d-4c9fad7e57f6 service glance] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:33.850128 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1339/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:34.258534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c6716-868d-4e38-857b-798973a8e96a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:34.259940 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-230c6716-868d-4e38-857b-798973a8e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:34.330140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c6716-868d-4e38-857b-798973a8e96a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:34.335131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:34.336419 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:34.336805 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:34.337088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:34.338911 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:34.350184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:34.351904 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:34.361705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1318/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:39.753696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:39.754166 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:39.754263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:39.771820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:39.773608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:39.826916 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1340/2658] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:39.839435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:39.909236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2289-cbd5-4b6e-946d-22e3ea296d68 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:39.915640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:39.916290 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:39.916600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:39.916879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:39.925193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:39.926781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023960-7047-4d0e-83e8-895b3237674f service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:39.935495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1319/2659] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:49.820633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=30 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:49.932263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=70 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:03.984703 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:03.997947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca405f-da3f-4531-870e-b324a55c4fc4 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:04.003502 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:04.004161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:04.004472 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:04.004792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:04.006589 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:04.019475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:04.021086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:04.032407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1341/2660] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:47:06.861273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:06.861786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:06.861882 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:06.879695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:06.880897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:06.888268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1320/2661] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:47:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:06.901692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:06.914245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85294e-3e80-4b07-8f92-1c691be07c86 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:06.919453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:06.920111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:06.920400 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:06.920718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:06.929740 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:06.931417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:06.939983 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1342/2662] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:47:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:47:16.874427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:16.936320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=12 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.761587 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:57.763105 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:57.847744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cccc5-9a34-41ba-aa0e-491008ca0cc7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:57.854426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:57.855045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.855326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.855599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.857603 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:57.873245 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:57.874965 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc86fb-81f1-45ad-9207-3956899e88a8 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:57.888973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1321/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:48:06.533252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:06.590280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2c5c-2aeb-48f6-a961-944c86c25933 service swift] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:06.597295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:06.597925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:06.598212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:06.598491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:06.601045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:06.615146 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:06.620549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:06.629077 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1343/2664] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:48:07.883558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:13.882748 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:13.883414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:13.883414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:13.902710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] MFA Rules not processed for user `4779e97de469458792d574e607fd8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:48:13.904178 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:13.911770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1322/2665] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:48:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:48:13.976806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:13.986962 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:14.017427 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d95b-9d06-4031-9036-d4e7ec7b0824 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:14.021457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:14.022279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:14.022568 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:14.022848 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:14.024752 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:14.064609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:14.066002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585fc5a-d70d-4555-a0a0-bd052ebc8766 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:14.088528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1344/2666] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:48:14.790217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:14.802886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abaee8-b5c8-4240-99b4-6c302c476e08 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:14.807971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:14.809435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:14.809818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:14.810327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:14.812275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:14.823727 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:14.825311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:14.836417 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1323/2667] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:48:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:48:22.283287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:22.283994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:22.283994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:22.305437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] MFA Rules not processed for user `1885c809018b4f0890028ba202aa415b`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:48:22.305437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:22.366992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1345/2668] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:48:23.016560 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:23.019411 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:23.043241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cfae7-0a08-403d-b4d4-09edcc30945e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:23.048993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:23.049885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:23.050171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:23.050452 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] PATH_INFO: `/v3/users/94d49cbc2d5d458881d3c2a5880f9109` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:23.064815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d49cbc2d5d458881d3c2a5880f9109)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:23.066700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:23.273524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d49cbc2d5d458881d3c2a5880f9109'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.274173 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d49cbc2d5d458881d3c2a5880f9109'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.274793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d49cbc2d5d458881d3c2a5880f9109'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.288369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d49cbc2d5d458881d3c2a5880f9109'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.297912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d49cbc2d5d458881d3c2a5880f9109'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.394071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1324/2669] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:48:23 2022] DELETE /identity/v3/users/94d49cbc2d5d458881d3c2a5880f9109 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:48:23.705738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:23.720766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92677-04bd-489c-8ad8-d548914adaf3 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:23.783453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:23.784393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:23.787193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:23.787193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] PATH_INFO: `/v3/projects/b60b9f54cde341cfb2e126fae67e13ef` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:23.787193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:23.796161 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60b9f54cde341cfb2e126fae67e13ef)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:23.798747 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:23.960094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60b9f54cde341cfb2e126fae67e13ef', 'request_id': 'req-3fb4448b-4b20-4623-8f11-fa184ae23c03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:23.967086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60b9f54cde341cfb2e126fae67e13ef', 'request_id': 'req-3fb4448b-4b20-4623-8f11-fa184ae23c03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.022367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60b9f54cde341cfb2e126fae67e13ef', 'request_id': 'req-3fb4448b-4b20-4623-8f11-fa184ae23c03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.033449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] The token cache is being invalidate because project b60b9f54cde341cfb2e126fae67e13ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:48:24.033751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.034366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.035897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1346/2670] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:48:23 2022] DELETE /identity/v3/projects/b60b9f54cde341cfb2e126fae67e13ef => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:48:24.040116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:24.041617 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:24.056528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3cffd-9333-4fe1-acfc-0241e6a47a97 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:24.119593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:24.120397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:24.120715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:24.120991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] PATH_INFO: `/v3/users/0d8ddc6b91004bfab9f53bb491d4f477` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:24.138121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8ddc6b91004bfab9f53bb491d4f477)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:24.140225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:24.339738 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:24.358489 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8ddc6b91004bfab9f53bb491d4f477'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.359293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8ddc6b91004bfab9f53bb491d4f477'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.359824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8ddc6b91004bfab9f53bb491d4f477'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.375490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8ddc6b91004bfab9f53bb491d4f477'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.379457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8ddc6b91004bfab9f53bb491d4f477'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:24.486514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1325/2671] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:48:24 2022] DELETE /identity/v3/users/0d8ddc6b91004bfab9f53bb491d4f477 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:48:24.750073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:24.751549 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:24.766068 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4448b-4b20-4623-8f11-fa184ae23c03 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:24.825453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:24.826407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:24.826889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:24.827009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] PATH_INFO: `/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:24.839994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ae9bb96c8448f2a33a685ac0eb4519)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:24.842139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:25.041923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ae9bb96c8448f2a33a685ac0eb4519', 'request_id': 'req-88074a58-aa34-4167-805d-a1abc301e803'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:25.048760 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ae9bb96c8448f2a33a685ac0eb4519', 'request_id': 'req-88074a58-aa34-4167-805d-a1abc301e803'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:25.143119 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ae9bb96c8448f2a33a685ac0eb4519', 'request_id': 'req-88074a58-aa34-4167-805d-a1abc301e803'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:25.154314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] The token cache is being invalidate because project 95ae9bb96c8448f2a33a685ac0eb4519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:48:25.154599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:25.155232 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:48:25.157028 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1347/2672] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:48:24 2022] DELETE /identity/v3/projects/95ae9bb96c8448f2a33a685ac0eb4519 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:48:35.057326 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:35.151090 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:52.116936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:48:52.118369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:52.207890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416b4e-d358-4859-b9ad-cbe4b0e9c983 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:48:52.266864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:48:52.267529 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:48:52.267812 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:48:52.268089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:48:52.270071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:48:52.281554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:48:52.283145 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439699-21c1-4773-931f-c7c433eed3a9 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:48:52.294085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1326/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:48:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:02.289390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=67 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.388157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:54.389668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:54.490249 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074a58-aa34-4167-805d-a1abc301e803 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:54.496551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:54.497209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:54.497495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:54.497782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:54.499575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:54.558231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:54.559866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:54.568819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1348/2674] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:04.564658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=68 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:15.296510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a335d-7678-46f4-8d85-55772fa0cd83 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:15.297007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a335d-7678-46f4-8d85-55772fa0cd83 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:15.297194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a335d-7678-46f4-8d85-55772fa0cd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:15.357363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a92a335d-7678-46f4-8d85-55772fa0cd83 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:15.358558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a92a335d-7678-46f4-8d85-55772fa0cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:15.430063 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1327/2675] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:15.712769 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:15.714172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:15.809652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cd97f-a7d8-485e-a8c3-00a7e638a74b service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:15.814757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:15.815414 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:15.815698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:15.815976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:15.824072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:15.825767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:15.834032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1349/2676] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:50:20.393078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:20.394012 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:20.394462 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:20.414353 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] MFA Rules not processed for user `4779e97de469458792d574e607fd8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:20.420277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:20.484204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1328/2677] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:25.830637 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=41 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:30.477134 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=69 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:35.185723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:35.187238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:35.246510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3d990-c063-46c2-8b12-e3b3530ece3f service swift] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:35.250431 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:35.252990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:35.252990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:35.252990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:35.253463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:35.264665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:35.266526 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:35.278199 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1350/2678] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:35.371703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:35.383067 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6233-2c72-496b-bf35-c8adfca32055 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:35.387187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:35.387774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:35.388131 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:35.388479 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:35.390409 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:35.406209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:35.407645 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61c7fc-ebf7-4404-b0c9-9740a01375d1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:35.419497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1329/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:36.452465 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:36.462000 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b6c37-c7a2-4d70-ab6c-e0b552a2e412 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:36.465733 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:36.466368 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:36.466647 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:36.466921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:36.468775 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:36.482901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:36.484377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:36.496377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1351/2680] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:38.318455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:38.319470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:38.319786 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:38.339986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:38.342013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:38.351021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1330/2681] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:38.364256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:38.376766 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83cece-159b-4130-93c6-1fccc81a0a0e service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:38.382821 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:38.383469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:38.383750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:38.384036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:38.392842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:38.394334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16966dd-5802-4a9e-8c9a-1747904f61ce service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:38.403659 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1352/2682] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:50:40.019176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:40.032287 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b033e-d03e-4a4a-b0a6-bd93a98156e1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:40.037286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:40.038865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:40.039147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:40.039422 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:40.041506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:40.058113 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:40.059886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:40.074625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1331/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:50:48.399780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=38 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:50.068824 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=15 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:57.323303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:57.323803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:57.323911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:57.341311 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:57.342508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:57.350152 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1353/2684] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:50:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:57.362429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:57.374435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0148-f5a9-4fcc-a219-10b85bb5a21b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:57.379504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:57.384395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:57.384395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:57.384395 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:57.388925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:57.390499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:57.398553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1332/2685] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:51:07.336104 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:07.395150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:51.305419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:51.318535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e94b-c762-4531-aadb-c2a9bfc8ac79 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:51.325176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:51.334857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:51.334857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:51.334857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:51.334857 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:51.338608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:51.340263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:51.349606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1354/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:55.420316 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:55.429671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401c37-daab-4e0b-89bc-7529e421867c service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:55.434388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:55.435020 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:55.435298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:55.435568 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:55.437331 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:55.446756 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:55.448704 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:55.456573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1333/2687] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:01.345466 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:02.705353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.714858 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238aa0-5fd9-466b-8674-69c10bcf602d service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.718826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.719485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.719758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.720039 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.722157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.785121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.786562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.796744 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1355/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:05.452956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:06.418774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:06.424759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.438478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59fdc-e910-4aaa-bbe1-7aec5981063f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:06.444348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:06.445206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.445747 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.446187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.449521 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.470065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:06.471977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:06.482286 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1334/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:06.599323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:06.600965 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.614003 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369ae4-1d6b-48ca-aa7d-004d91a74523 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:06.619314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:06.620212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.620599 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.620955 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] PATH_INFO: `/v3/users/1885c809018b4f0890028ba202aa415b` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.622220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1885c809018b4f0890028ba202aa415b)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:06.624168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:06.846233 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1885c809018b4f0890028ba202aa415b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.846886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1885c809018b4f0890028ba202aa415b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.847528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1885c809018b4f0890028ba202aa415b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.859440 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1885c809018b4f0890028ba202aa415b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.866451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f410db61-8209-47a9-b5b5-9db5f8377b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1885c809018b4f0890028ba202aa415b'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.946561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1356/2690] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:06 2022] DELETE /identity/v3/users/1885c809018b4f0890028ba202aa415b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:07.204340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.215471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975cc3-2f6f-4348-911d-0e7b9e72f04f service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.272295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.273213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.273480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.273755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] PATH_INFO: `/v3/projects/21bdae6c05954d4aa06501fec56a19a2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.274937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bdae6c05954d4aa06501fec56a19a2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.276924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.397213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bdae6c05954d4aa06501fec56a19a2', 'request_id': 'req-dfadbe8e-890b-4640-8cdf-963e4a1311e4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.403247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bdae6c05954d4aa06501fec56a19a2', 'request_id': 'req-dfadbe8e-890b-4640-8cdf-963e4a1311e4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.409266 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bdae6c05954d4aa06501fec56a19a2', 'request_id': 'req-dfadbe8e-890b-4640-8cdf-963e4a1311e4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.510941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] The token cache is being invalidate because project 21bdae6c05954d4aa06501fec56a19a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:07.511555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.511764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dfadbe8e-890b-4640-8cdf-963e4a1311e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.513370 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1335/2691] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:07 2022] DELETE /identity/v3/projects/21bdae6c05954d4aa06501fec56a19a2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:07.518307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.518602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.518883 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.577393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:07.578613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.608988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:07.636812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1357/2692] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:07.645345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.645634 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.645913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.664369 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:07.665590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.674472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1336/2693] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:07.678572 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.688596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095b0f-666d-4a18-a0e7-531172d467b0 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.693764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.694421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.694704 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.694980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.695701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:07.696007 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.697638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.708896 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1358/2694] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:07.713231 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.722860 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a919-c957-43a8-831b-cc0e62f7559d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.727853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.728533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.728818 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.729094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.729794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.732323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.839070 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1337/2695] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:07.843864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.854057 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59527845-381d-42a1-8c52-162c05a6097f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.914002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.914679 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.914964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.915242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.915944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.917919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.024334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1359/2696] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:08.025592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.037360 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eca79-637e-455b-905e-fd5386643fca admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.042218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.042928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.043470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.043776 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.045084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.046726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.058554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1338/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:08.062551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.073227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644ccfc-2be1-47da-a004-2a6194811ade admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.078826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.079497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.079780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.080056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.080824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.082424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320009-915e-496c-a821-652b62c383a8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.093359 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1360/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:08.097778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.107977 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac2b8-043e-45ad-8396-eebd851b46d0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.113013 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.113908 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.114193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.114471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] PATH_INFO: `/v3/projects/18aadfa2970d487c9a28395099b2499e/users/96bc1fd7bd7448ca87e1daa0bebd5fd3/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.130868 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aadfa2970d487c9a28395099b2499e, user_id=96bc1fd7bd7448ca87e1daa0bebd5fd3, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.133627 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.221041 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1339/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:08 2022] PUT /identity/v3/projects/18aadfa2970d487c9a28395099b2499e/users/96bc1fd7bd7448ca87e1daa0bebd5fd3/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:08.226223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396d3a-b1fe-42b2-a0a3-a63e488c4855 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.226508 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396d3a-b1fe-42b2-a0a3-a63e488c4855 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.226782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396d3a-b1fe-42b2-a0a3-a63e488c4855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.244460 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-45396d3a-b1fe-42b2-a0a3-a63e488c4855 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:08.245686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-45396d3a-b1fe-42b2-a0a3-a63e488c4855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:08.305970 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1361/2700] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:08.316142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.317898 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:08.333388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:08.375021 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d53a-d22a-4615-b225-680ae8bbe61b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.378618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.379263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.379541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.379815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.389714 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.391157 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.401205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1340/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:10.518186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:10.518186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:10.518186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:10.543590 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] MFA Rules not processed for user `96bc1fd7bd7448ca87e1daa0bebd5fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:10.546070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:10.715428 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:10.763824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1362/2702] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:10.768307 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:10.780033 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda8609-6ead-4b6a-a83f-567110039933 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:10.785284 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:10.785954 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:10.786239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:10.786518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:10.787220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:10.789219 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:10.939798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1341/2703] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:10 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:10.941033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:10.953298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a46f0-7b63-4b20-ae06-da5472b14f9b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.009909 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.010584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.010899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.011176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.011895 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.014587 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.181546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1363/2704] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:10 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:11.187125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.197190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873561b-1f54-4b2a-9837-4838069550e2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.202612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.203262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.203540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.203813 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.204558 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.206151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.216945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1342/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:11.221059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.231097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf03c2-9aa5-4509-ae46-7375821d3632 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.235879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.236819 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.237105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.237384 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] PATH_INFO: `/v3/projects/98878ea7fa3c4bb89178838e60c95f02/users/04e511320e114f36857ed6f35433ac7d/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.252719 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98878ea7fa3c4bb89178838e60c95f02, user_id=04e511320e114f36857ed6f35433ac7d, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.255424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.363609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1364/2706] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:11 2022] PUT /identity/v3/projects/98878ea7fa3c4bb89178838e60c95f02/users/04e511320e114f36857ed6f35433ac7d/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:11.367586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.378525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d844-b7a6-4912-93c1-a8ef57d2b471 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.433956 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.435184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.435184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.435741 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.436469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.438094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e085a-bd5a-4196-9a47-0ac5cab4b0ed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.447695 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1343/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:11.452784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.462959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38699-2b33-4747-8966-3aa490ef25d3 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.467999 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.468903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.469182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.469451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] PATH_INFO: `/v3/projects/98878ea7fa3c4bb89178838e60c95f02/users/04e511320e114f36857ed6f35433ac7d/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.471380 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98878ea7fa3c4bb89178838e60c95f02, user_id=04e511320e114f36857ed6f35433ac7d, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.474038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.484988 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1365/2708] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:11 2022] PUT /identity/v3/projects/98878ea7fa3c4bb89178838e60c95f02/users/04e511320e114f36857ed6f35433ac7d/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:13.050305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.050871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.051300 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.091359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] MFA Rules not processed for user `04e511320e114f36857ed6f35433ac7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:13.092719 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.163605 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1344/2709] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:13.741609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.743319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.823171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449626af-aca3-4c92-ab90-74b7be348759 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.828845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.829491 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.829767 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.830040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.831805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.844023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.845609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.855250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1366/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:14.964255 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.970801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:15.031485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e79b-6a3e-4eb2-90ab-29c8be4528cd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.039156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.039156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.039156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.039156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] PATH_INFO: `/v3/users/96bc1fd7bd7448ca87e1daa0bebd5fd3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.039590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bc1fd7bd7448ca87e1daa0bebd5fd3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.040745 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.240672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bc1fd7bd7448ca87e1daa0bebd5fd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.241327 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bc1fd7bd7448ca87e1daa0bebd5fd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.241974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bc1fd7bd7448ca87e1daa0bebd5fd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.254298 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bc1fd7bd7448ca87e1daa0bebd5fd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.262948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16484995-3b7b-4278-ae64-4dc123c96350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bc1fd7bd7448ca87e1daa0bebd5fd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.369344 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1345/2711] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:14 2022] DELETE /identity/v3/users/96bc1fd7bd7448ca87e1daa0bebd5fd3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:15.623709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.636343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90553fa-b973-4f72-a196-d525245e06b1 service placement] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.645245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:15.692540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.693315 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.693598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.693873 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] PATH_INFO: `/v3/projects/18aadfa2970d487c9a28395099b2499e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.695049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18aadfa2970d487c9a28395099b2499e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.697029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.718985 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.719296 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.722263 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.737491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] MFA Rules not processed for user `4779e97de469458792d574e607fd8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:15.738698 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.795253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1346/2712] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:15.822459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18aadfa2970d487c9a28395099b2499e', 'request_id': 'req-d22b698c-a8f9-4f37-89a7-25d08940df4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.830235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18aadfa2970d487c9a28395099b2499e', 'request_id': 'req-d22b698c-a8f9-4f37-89a7-25d08940df4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.871447 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18aadfa2970d487c9a28395099b2499e', 'request_id': 'req-d22b698c-a8f9-4f37-89a7-25d08940df4e'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.883052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] The token cache is being invalidate because project 18aadfa2970d487c9a28395099b2499e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:15.883339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.883981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.892764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1367/2713] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:15 2022] DELETE /identity/v3/projects/18aadfa2970d487c9a28395099b2499e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:15.894217 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.902869 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.928240 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b7a5d-8d06-4e77-8b95-cee05c7d89e9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.957430 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:15.987929 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.988958 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.989235 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.989505 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] PATH_INFO: `/v3/users/04e511320e114f36857ed6f35433ac7d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.990796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e511320e114f36857ed6f35433ac7d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.992864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.123224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.124671 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.186305 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b698c-a8f9-4f37-89a7-25d08940df4e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.190101 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.190781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.191065 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.191344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.193126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.207164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.207164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.213312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1368/2714] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:16.315517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e511320e114f36857ed6f35433ac7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.316274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e511320e114f36857ed6f35433ac7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.316899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e511320e114f36857ed6f35433ac7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.329202 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e511320e114f36857ed6f35433ac7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.336006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e511320e114f36857ed6f35433ac7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.422119 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1347/2715] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:15 2022] DELETE /identity/v3/users/04e511320e114f36857ed6f35433ac7d => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:16.611615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.613047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.671468 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:16.692018 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4506-b388-4578-84be-ad6465af263e service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.702147 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.703614 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.767887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.768593 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.768878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.769175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.770992 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.781692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062ab2-5289-4bac-a8dc-fce2a972603c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.783135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.784882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d228b-eed9-47e1-b909-9be54f0d55f1 service placement] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.786292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.787160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.790750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.790750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] PATH_INFO: `/v3/projects/98878ea7fa3c4bb89178838e60c95f02` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.790750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98878ea7fa3c4bb89178838e60c95f02)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.791001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.796273 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1369/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:16.920897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98878ea7fa3c4bb89178838e60c95f02', 'request_id': 'req-4e2c8336-d752-4adf-b2de-ced7e711f765'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.922246 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:16.928399 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98878ea7fa3c4bb89178838e60c95f02', 'request_id': 'req-4e2c8336-d752-4adf-b2de-ced7e711f765'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.934283 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98878ea7fa3c4bb89178838e60c95f02', 'request_id': 'req-4e2c8336-d752-4adf-b2de-ced7e711f765'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:17.025441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] The token cache is being invalidate because project 98878ea7fa3c4bb89178838e60c95f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:17.026107 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:17.026391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4e2c8336-d752-4adf-b2de-ced7e711f765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:17.029377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1348/2717] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:16 2022] DELETE /identity/v3/projects/98878ea7fa3c4bb89178838e60c95f02 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:17.035697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.035978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.036370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.054303 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.055506 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.114536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1370/2718] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.124224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.124539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.124822 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.144230 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.146662 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.155762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1349/2719] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.160673 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.170890 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b108-4264-406b-87b1-ad1ee02f01f8 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.176052 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.176774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.177062 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.177321 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.178045 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:17.178349 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.180008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.192978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1371/2720] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:17.197116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.207204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c30e6-08cb-4135-8105-50c3bad3784f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.212128 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.213017 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.213402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.213715 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.214408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.216612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.313730 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1350/2721] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:17.314871 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.325872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412adc38-be20-4738-8ed1-109dfca64f2a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.380129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.380818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.381102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.381377 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.382053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.383953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.394925 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:17.518117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1372/2722] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:17.522206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.533001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6608-2896-4284-bdb7-9f674941688f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.537594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.538345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.538578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.538855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.539582 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.541208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.555600 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1351/2723] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:17.556824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.567594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70ea7-e59c-40ae-bac5-b6f27b382b90 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.572235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.572924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.573216 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.573489 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.574210 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.575897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a661-1f20-4050-b94c-6f09d40a39ce admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.585592 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1373/2724] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:17.589588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.599438 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a54aef-9834-40c6-b36e-3f26f4aa44cd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.603980 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.604891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.605171 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.605446 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] PATH_INFO: `/v3/projects/57511963b1d645b0a7f38945d239488f/users/90d35c87aed4410e887efb0b7b7549ca/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.624837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57511963b1d645b0a7f38945d239488f, user_id=90d35c87aed4410e887efb0b7b7549ca, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.627519 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.748151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1352/2725] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:17 2022] PUT /identity/v3/projects/57511963b1d645b0a7f38945d239488f/users/90d35c87aed4410e887efb0b7b7549ca/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:17.758186 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.758645 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.758794 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.784867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] MFA Rules not processed for user `90d35c87aed4410e887efb0b7b7549ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.786085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.850299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1374/2726] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.854879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.924920 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fb27-9534-4167-a354-ff6bccab5c8d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.929702 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.930394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.930676 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.930953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.931677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.933706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.016357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1353/2727] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.020393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.031967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144e113-4dd2-489f-9cec-cc9ed50f46ac None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.087088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.087764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.088046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.088319 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.089056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.091606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.200313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1375/2728] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.202116 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.212392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f612c7-2b01-4b03-9e25-b514c43be215 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.217047 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.217706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.217984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.218259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.219006 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.220625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.231056 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1354/2729] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.235329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.245203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426d8ad-2dfe-46a3-ae77-d8b8dc0a0b57 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.250353 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.251230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.251505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.251774 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] PATH_INFO: `/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf/users/4362eddff7e842fb876d532d84c1393f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.266798 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fa00a4b1b1470e8883d1958d54abdf, user_id=4362eddff7e842fb876d532d84c1393f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.269487 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.346990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1376/2730] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:18 2022] PUT /identity/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf/users/4362eddff7e842fb876d532d84c1393f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:18.350916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.361659 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc92d79-48c2-4a4e-aee5-d5762e056408 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.406384 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:18.417856 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.418781 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.420023 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.420312 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.421077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.422663 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf709b-b300-46eb-ae35-89ed24afb6c3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.432810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1355/2731] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.438310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.448570 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc622c-2de8-4ccb-9167-e338cbc2fc39 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.453355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.454238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.454523 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.454784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] PATH_INFO: `/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf/users/4362eddff7e842fb876d532d84c1393f/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.456791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fa00a4b1b1470e8883d1958d54abdf, user_id=4362eddff7e842fb876d532d84c1393f, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.459434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.469476 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1377/2732] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:18 2022] PUT /identity/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf/users/4362eddff7e842fb876d532d84c1393f/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:18.479865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.480177 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.480456 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.507722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] MFA Rules not processed for user `4362eddff7e842fb876d532d84c1393f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:18.508972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:18.576583 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1356/2733] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:18.587111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.588875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:18.623997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:18.675054 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263082-4328-4539-9230-b909d645ba6a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.678853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.679496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.679776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.680046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.689697 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.691107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3df15-ff7c-43a9-b85f-8c45fd20b8bb service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.701811 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1378/2734] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:20.051517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:20.117718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71865-85fa-457c-8b63-23343f852839 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:20.123104 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:20.123993 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:20.124279 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:20.124598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] PATH_INFO: `/v3/users/90d35c87aed4410e887efb0b7b7549ca` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.125816 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d35c87aed4410e887efb0b7b7549ca)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:20.127859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:20.500109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d35c87aed4410e887efb0b7b7549ca'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:20.500888 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d35c87aed4410e887efb0b7b7549ca'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:20.501835 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d35c87aed4410e887efb0b7b7549ca'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:20.515397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d35c87aed4410e887efb0b7b7549ca'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:20.520854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:20.523391 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d35c87aed4410e887efb0b7b7549ca'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:20.611916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1357/2735] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:20 2022] DELETE /identity/v3/users/90d35c87aed4410e887efb0b7b7549ca => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:20.616394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:20.616913 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:20.617251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.636220 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:20.637510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:20.698866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1379/2736] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:20.709275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:20.711269 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:20.794661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a66e5-f465-44fb-af5c-36b4a87d1b58 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:20.798346 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:20.799085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:20.799437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:20.799876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.810797 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:20.812351 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:20.824517 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1358/2737] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:21.365270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.372069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:21.381948 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f4f0-d5ea-4056-8f70-a1868e603ccb None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.386837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.388362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.388362 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.388734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] PATH_INFO: `/v3/projects/57511963b1d645b0a7f38945d239488f` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.389982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57511963b1d645b0a7f38945d239488f)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.392055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.506625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57511963b1d645b0a7f38945d239488f', 'request_id': 'req-108d3f1d-464b-4315-864e-769f8d52855a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.512953 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57511963b1d645b0a7f38945d239488f', 'request_id': 'req-108d3f1d-464b-4315-864e-769f8d52855a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.638048 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57511963b1d645b0a7f38945d239488f', 'request_id': 'req-108d3f1d-464b-4315-864e-769f8d52855a'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.649223 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] The token cache is being invalidate because project 57511963b1d645b0a7f38945d239488f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:21.649510 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.650160 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.651712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1380/2738] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:21 2022] DELETE /identity/v3/projects/57511963b1d645b0a7f38945d239488f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:21.656601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.675612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd314d87-fe42-4318-95aa-93bcb664da57 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.732294 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.733225 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.733508 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.733833 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] PATH_INFO: `/v3/users/4362eddff7e842fb876d532d84c1393f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.735008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4362eddff7e842fb876d532d84c1393f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.736957 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.863074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4362eddff7e842fb876d532d84c1393f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.863723 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4362eddff7e842fb876d532d84c1393f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.864323 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4362eddff7e842fb876d532d84c1393f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.876460 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4362eddff7e842fb876d532d84c1393f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.883179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-57cd9553-b3ce-4c86-82fa-75546fc8e30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4362eddff7e842fb876d532d84c1393f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:21.940317 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1359/2739] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:21 2022] DELETE /identity/v3/users/4362eddff7e842fb876d532d84c1393f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:22.343209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:22.346705 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:22.360972 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3f1d-464b-4315-864e-769f8d52855a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:22.396746 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:22.422404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:22.423282 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.423565 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.423841 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] PATH_INFO: `/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.425072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fa00a4b1b1470e8883d1958d54abdf)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:22.432392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:22.591742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fa00a4b1b1470e8883d1958d54abdf', 'request_id': 'req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:22.597818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fa00a4b1b1470e8883d1958d54abdf', 'request_id': 'req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:22.712051 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fa00a4b1b1470e8883d1958d54abdf', 'request_id': 'req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:22.722777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] The token cache is being invalidate because project d1fa00a4b1b1470e8883d1958d54abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:22.723088 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:22.723715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-f37a1c8d-6c4e-4996-aa2c-e68b1c4ac902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:22.725289 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1381/2740] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:22 2022] DELETE /identity/v3/projects/d1fa00a4b1b1470e8883d1958d54abdf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:22.730355 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.730830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.735834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.749437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:22.750684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:22.755997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:22.811432 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1360/2741] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:22.819185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.819470 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.819750 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.837866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:22.839080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:22.847419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1382/2742] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:22.851576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:22.862392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa9099-08be-4eb6-bb90-592ddfaf9f57 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:22.866913 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:22.867567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.867854 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.868129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.868889 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:22.869197 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:22.870815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:22.882713 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1361/2743] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:22.886800 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:22.896438 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833065c-c260-4ab9-bb20-4400b6e45f23 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:22.901270 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:22.901936 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.902219 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.902495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.903280 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:22.905537 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.027609 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1383/2744] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:22 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:23.031906 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.042014 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe5ef-2a7e-4cde-bb83-afe11f5fe465 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.099413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.100083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.100373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.100686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.101390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.103329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.231992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1362/2745] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:23 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:23.236094 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.246253 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5598-f957-4127-aaf7-40e19d7bfaa1 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.250876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.251540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.251824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.252099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.253134 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.254742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.265079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1384/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:23.269718 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.280267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aecda-fcd5-49eb-b549-b807ab77570c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.284867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.285525 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.285810 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.286089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.286814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.288436 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5cd6b-55f3-4b79-b9e5-c927f24982e5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.299350 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1363/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:23.303296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.313334 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0017a-502c-4752-9dc7-441d5792f506 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.317897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.318776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.319060 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.319335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] PATH_INFO: `/v3/projects/25a1853df12041b0983dfed7bae439f6/users/f6e481c442bd423da13012f3eae11acd/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.333643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a1853df12041b0983dfed7bae439f6, user_id=f6e481c442bd423da13012f3eae11acd, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.336644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.409738 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1385/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:23 2022] PUT /identity/v3/projects/25a1853df12041b0983dfed7bae439f6/users/f6e481c442bd423da13012f3eae11acd/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:23.420903 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.421190 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.421468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.447343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] MFA Rules not processed for user `f6e481c442bd423da13012f3eae11acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:23.448595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:23.513825 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1364/2749] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:23.525043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.526987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:23.586651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59d13-3870-4a72-b7bf-f331f9bdd22c admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.590323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.591558 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.591835 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.592108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.601218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.603207 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cc8e2-e2a8-477e-b877-f735b47638ff service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.612178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1386/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:23.632193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:23.644075 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:23.698125 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60d439-e271-4105-9548-42d5d14d1f67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:23.703592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:23.704556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.704837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.705114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] PATH_INFO: `/v3/users/f6e481c442bd423da13012f3eae11acd` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.706339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e481c442bd423da13012f3eae11acd)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:23.708853 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:23.874079 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e481c442bd423da13012f3eae11acd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:23.874766 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e481c442bd423da13012f3eae11acd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:23.875397 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e481c442bd423da13012f3eae11acd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:23.887082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e481c442bd423da13012f3eae11acd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:23.894661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e481c442bd423da13012f3eae11acd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:23.975233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1365/2751] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:23 2022] DELETE /identity/v3/users/f6e481c442bd423da13012f3eae11acd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:23.979923 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:23.980418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:23.980546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:23.986402 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:23.998943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:24.000147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:24.057503 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1387/2752] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:24.067842 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:24.069275 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:24.144524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742d56-d516-442f-838f-bcb71bb88a27 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:24.144524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:24.144524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:24.144524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:24.145030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:24.145030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:24.145030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5234db-d8b6-44db-bfb0-55de5a5f57e8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:24.151385 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1366/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:24.657409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:24.658908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:24.672335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165d22-8110-4cd2-b551-657c038cf800 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:24.677228 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:24.678235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:24.679110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:24.679110 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] PATH_INFO: `/v3/projects/25a1853df12041b0983dfed7bae439f6` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:24.680237 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a1853df12041b0983dfed7bae439f6)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:24.682389 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:24.831513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a1853df12041b0983dfed7bae439f6', 'request_id': 'req-21e637a1-54e1-4ee0-9834-c4d5528622a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:24.837966 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a1853df12041b0983dfed7bae439f6', 'request_id': 'req-21e637a1-54e1-4ee0-9834-c4d5528622a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:24.923095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a1853df12041b0983dfed7bae439f6', 'request_id': 'req-21e637a1-54e1-4ee0-9834-c4d5528622a4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:24.934027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] The token cache is being invalidate because project 25a1853df12041b0983dfed7bae439f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:24.934338 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:24.935005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-21e637a1-54e1-4ee0-9834-c4d5528622a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:24.936571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1388/2754] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:24 2022] DELETE /identity/v3/projects/25a1853df12041b0983dfed7bae439f6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:24.941595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:24.950612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:24.950612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:24.960373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:24.961648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:24.986365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.020687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1367/2755] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:25.029176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.029670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.029808 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.048475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:25.049692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:25.057528 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1389/2756] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:25.061919 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.071808 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57db0-64dd-4245-a152-16ca4739c7e7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.078151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.078846 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.079132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.079412 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.080137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:25.080445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.082089 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.094661 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1368/2757] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:25.098887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.108222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56670-beaa-42a5-8d6f-df15ac3f1b2c None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.112971 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.113621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.113902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.114176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.114901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.116817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.193561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1390/2758] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:25 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:25.197555 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.208638 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f616b6-1fae-4a5f-9087-82c241e72755 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.264936 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.265602 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.265907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.266184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.266879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.268836 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.363586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1369/2759] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:25 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:25.367823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.379561 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ef2-85e3-4e38-a7f0-ab25bb5c5352 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.384367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.385061 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.385344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.385622 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.386344 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.388761 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.400288 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1391/2760] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:25.404238 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.414362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351218ca-d3ac-4ce3-b515-1d9f2315d3fd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.419948 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.420127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.420410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.420722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.421451 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.423065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6260-2be6-4e58-8fee-d486c023b5b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.433186 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1370/2761] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:25.438194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.448509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99893ea4-0cdd-4319-8e64-d20325d99828 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.453864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.454854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.455136 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.455689 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] PATH_INFO: `/v3/projects/ddc34e0746d9469dba18aca39394acae/users/9704923b18f14cc5b06cc49a31c2b084/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.470756 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc34e0746d9469dba18aca39394acae, user_id=9704923b18f14cc5b06cc49a31c2b084, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.473467 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.541041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1392/2762] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:25 2022] PUT /identity/v3/projects/ddc34e0746d9469dba18aca39394acae/users/9704923b18f14cc5b06cc49a31c2b084/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:25.552162 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.552453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.552764 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.580744 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] MFA Rules not processed for user `9704923b18f14cc5b06cc49a31c2b084`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:25.581968 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:25.648646 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1371/2763] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:25.660536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.662244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:25.690016 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.722032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b9b9d-0c8d-432c-b554-303a91ed61b0 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.728914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.728914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.728914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.728914 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.737174 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:25.738642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:25.748329 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1393/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:27.703696 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:27.705445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:27.736111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.782239 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa40ae-1bd8-49bc-b91c-b4663c6c9da1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:27.787668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:27.788315 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:27.788652 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:27.788934 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:27.790689 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:27.803754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:27.805488 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca223d3-ec60-4bf7-9958-de8aaa315a9f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:27.816435 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1372/2765] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:35.844357 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.911700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2f26-414a-48c5-b3f6-b1f90d4e4f28 service cinder] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.916286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.917191 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.917471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.917742 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] PATH_INFO: `/v3/users/9704923b18f14cc5b06cc49a31c2b084` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.919197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9704923b18f14cc5b06cc49a31c2b084)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.921178 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.121231 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9704923b18f14cc5b06cc49a31c2b084'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.121968 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9704923b18f14cc5b06cc49a31c2b084'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.122606 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9704923b18f14cc5b06cc49a31c2b084'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.136263 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9704923b18f14cc5b06cc49a31c2b084'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.143667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9704923b18f14cc5b06cc49a31c2b084'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.215367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1394/2766] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:35 2022] DELETE /identity/v3/users/9704923b18f14cc5b06cc49a31c2b084 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:36.220570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.221088 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.221193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.240027 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:36.241267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.304322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1373/2767] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:36.315455 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.316969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.368696 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:36.381325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f97a-dd3c-45cf-8450-2611c7ca52c0 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.385023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.385690 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.385969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.386246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.397208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.398644 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.408828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1395/2768] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:36.776774 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.778289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.791352 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f4b4-4fc3-4777-9e68-fe9c280bdb6f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.797117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.797117 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.797953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.798228 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] PATH_INFO: `/v3/projects/ddc34e0746d9469dba18aca39394acae` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.799439 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc34e0746d9469dba18aca39394acae)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.801406 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.901073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc34e0746d9469dba18aca39394acae', 'request_id': 'req-c430245a-85d4-4656-a2f4-60e3e043a80d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.908260 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc34e0746d9469dba18aca39394acae', 'request_id': 'req-c430245a-85d4-4656-a2f4-60e3e043a80d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.913760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc34e0746d9469dba18aca39394acae', 'request_id': 'req-c430245a-85d4-4656-a2f4-60e3e043a80d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.974161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] The token cache is being invalidate because project ddc34e0746d9469dba18aca39394acae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:36.974533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.975166 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.976770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1374/2769] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:36 2022] DELETE /identity/v3/projects/ddc34e0746d9469dba18aca39394acae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:46.477095 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:46.970943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:55.634424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:55.636013 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:55.717451 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2363-614b-4422-a942-f805451ff703 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:55.796340 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:55.797148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:55.797516 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:55.797863 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:55.799826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:55.814586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:55.816370 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:55.830172 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1396/2770] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:56.094701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:56.096141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:56.190928 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430245a-85d4-4656-a2f4-60e3e043a80d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:56.196941 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:56.197599 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:56.197879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:56.198150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:56.200110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:56.215447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:56.218099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:56.228691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1375/2771] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:02.488342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:02.489843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:02.546588 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6bac-413d-4dfd-9f8e-a3b38021de43 service nova] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:02.550404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:02.551415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:02.551415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:02.551638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:02.553404 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:02.592331 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=100 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:02.617862 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:02.623193 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:02.630633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1397/2772] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:06.224165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=32 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:06.625136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:06.626608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:06.640660 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509677a-5055-4cac-a760-2cfde8d271a5 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:06.645375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:06.646247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:06.646532 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:06.646803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] PATH_INFO: `/v3/users/4779e97de469458792d574e607fd8a1f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:06.647996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4779e97de469458792d574e607fd8a1f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:06.649961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:06.861458 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4779e97de469458792d574e607fd8a1f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:06.862121 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4779e97de469458792d574e607fd8a1f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:06.862736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4779e97de469458792d574e607fd8a1f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:06.875292 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4779e97de469458792d574e607fd8a1f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:06.882156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5d76865b-cc4e-411d-9a62-5140e873f71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4779e97de469458792d574e607fd8a1f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:06.939343 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1376/2773] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:06 2022] DELETE /identity/v3/users/4779e97de469458792d574e607fd8a1f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:07.249382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:07.260879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8985d-99d5-4fc2-8c1d-0a9c33dddb75 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:07.319595 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:07.320453 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.320755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.321029 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] PATH_INFO: `/v3/projects/d17a97aafb584c31a3cc404634d95885` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.322197 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17a97aafb584c31a3cc404634d95885)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:07.324129 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:07.413398 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17a97aafb584c31a3cc404634d95885', 'request_id': 'req-9e99bd48-9403-4305-ac51-35da0285e9bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:07.419511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17a97aafb584c31a3cc404634d95885', 'request_id': 'req-9e99bd48-9403-4305-ac51-35da0285e9bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:07.481888 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17a97aafb584c31a3cc404634d95885', 'request_id': 'req-9e99bd48-9403-4305-ac51-35da0285e9bc'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:07.494686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] The token cache is being invalidate because project d17a97aafb584c31a3cc404634d95885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:07.494686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:07.494686 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-9e99bd48-9403-4305-ac51-35da0285e9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:07.496356 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1398/2774] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:07 2022] DELETE /identity/v3/projects/d17a97aafb584c31a3cc404634d95885 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:07.499890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.500371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.500480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.519065 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:07.520394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:07.578884 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1377/2775] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:07.587049 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.587358 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.587633 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.606268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:07.607781 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:07.615497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1399/2776] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:07.619653 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:07.629206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952f02-ba0e-495c-b187-8836f8074133 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:07.633760 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:07.634410 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.634690 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.634966 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.635706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:07.636009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:07.638208 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:07.649544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1378/2777] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:07.654415 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:07.663919 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700af0-9d26-4be4-872f-573dd41853ff None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:07.668646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:07.669418 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.669947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.670221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.670905 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:07.672826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:07.780456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1400/2778] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:07 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:07.784672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:07.794554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f790f-c957-4879-ae4b-3b89078699f5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:07.850280 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:07.850986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.851274 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.851553 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.852257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:07.854340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:07.860943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:07.957083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1379/2779] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:07 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:54:07.961355 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:07.971773 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406194cb-12ea-41ad-a5f1-e1d4ec94c352 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:07.976422 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:07.977116 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:07.977403 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:07.977755 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:07.978437 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:07.980031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:07.990325 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1401/2780] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:08.000751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.010557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018fb1d-4896-4bdf-962b-870144b33e4a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.016064 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.016751 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.017036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.017313 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.018073 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.019701 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689aa06-a6a8-4a40-b028-06a9d81643b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.030404 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1380/2781] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:08.036471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.047268 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7615-e739-4eae-a2ee-903e94e8bb57 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.052410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.053339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.053625 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.053900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] PATH_INFO: `/v3/projects/a3f43e60571340dd9ef0a6cca46df7bc/users/94f2ad696a9d4e7991261ab7ae17b6d4/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.066363 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:08.069313 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f43e60571340dd9ef0a6cca46df7bc, user_id=94f2ad696a9d4e7991261ab7ae17b6d4, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.071967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.167706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1402/2782] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:08 2022] PUT /identity/v3/projects/a3f43e60571340dd9ef0a6cca46df7bc/users/94f2ad696a9d4e7991261ab7ae17b6d4/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:08.179447 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.179769 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.180049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.207151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] MFA Rules not processed for user `94f2ad696a9d4e7991261ab7ae17b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:08.208374 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:08.271565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1381/2783] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:08.276021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.336388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa9e0-1932-40a9-8c26-0463ab077e44 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.341085 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.341839 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.342121 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.342393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.343069 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.344986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.465462 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1403/2784] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:08 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:08.470598 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.481540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf385-2bad-4df2-bff8-040a02e9f24f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.539418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.540103 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.540322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.540631 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.541368 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.543308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.625136 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1382/2785] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:08 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:54:08.629026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.639718 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca24714-9846-4709-9d99-c2b2875e3fc4 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.644844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.645504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.645785 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.646139 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.646892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.648560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.659899 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1404/2786] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:08.664469 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.676988 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35831-8e6b-4f5a-874b-d59f4e471b05 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.681666 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.682557 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.682837 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.683111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] PATH_INFO: `/v3/projects/07467d4e794647009b387b6c458030e8/users/bfdb28d8648f41be8156e59cc0085d03/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.698834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07467d4e794647009b387b6c458030e8, user_id=bfdb28d8648f41be8156e59cc0085d03, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.701912 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.768999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1383/2787] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:08 2022] PUT /identity/v3/projects/07467d4e794647009b387b6c458030e8/users/bfdb28d8648f41be8156e59cc0085d03/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:08.773147 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.784001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8727-418f-4721-99e8-7b0b6e5c8b6e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.839533 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.840195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.840475 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.840780 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.842041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.843650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebe2a5-e08a-4d64-b72e-6131493eee03 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.853078 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1405/2788] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:08.857684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:08.868133 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedcbb1-236d-4fbd-afdf-c501961e5033 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:08.872838 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:08.873711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.873991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.874267 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] PATH_INFO: `/v3/projects/07467d4e794647009b387b6c458030e8/users/bfdb28d8648f41be8156e59cc0085d03/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.876293 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07467d4e794647009b387b6c458030e8, user_id=bfdb28d8648f41be8156e59cc0085d03, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:08.878952 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:08.889576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1384/2789] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:08 2022] PUT /identity/v3/projects/07467d4e794647009b387b6c458030e8/users/bfdb28d8648f41be8156e59cc0085d03/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:08.899721 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:08.900012 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:08.900290 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:08.926829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] MFA Rules not processed for user `bfdb28d8648f41be8156e59cc0085d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:08.928047 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:08.974607 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:08.994396 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1406/2790] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:09.006181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:09.007992 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:09.034528 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:09.069817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0fd2-2a84-4891-a728-478bbdde7606 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:09.073504 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:09.074149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:09.074482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:09.074961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:09.086381 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:09.089109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f019f3-69cd-4816-9509-479b38b4fb97 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:09.098303 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1385/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:10.087900 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:10.149495 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd2cbc-20b7-416c-b298-6f41c41ee7af None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:10.154033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:10.155485 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:10.155765 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:10.156043 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] PATH_INFO: `/v3/users/94f2ad696a9d4e7991261ab7ae17b6d4` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:10.157258 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f2ad696a9d4e7991261ab7ae17b6d4)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:10.159171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:10.405554 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f2ad696a9d4e7991261ab7ae17b6d4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:10.406024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f2ad696a9d4e7991261ab7ae17b6d4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:10.406634 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f2ad696a9d4e7991261ab7ae17b6d4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:10.418297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f2ad696a9d4e7991261ab7ae17b6d4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:10.425494 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f2ad696a9d4e7991261ab7ae17b6d4'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:10.555646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1407/2792] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:10 2022] DELETE /identity/v3/users/94f2ad696a9d4e7991261ab7ae17b6d4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:10.560179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:10.560677 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:10.560799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:10.578567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:10.581094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:10.636345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1386/2793] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:10.646675 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:10.648168 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:10.705086 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98843-d0e1-45e9-8304-59d0e3d431b5 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:10.709031 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:10.709786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:10.710074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:10.710433 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:10.720410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:10.721880 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:10.731235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1408/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:11.174991 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:11.176426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:11.190943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eade06-86f2-479b-b20a-484e305b9cf0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:11.195647 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:11.196539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:11.196823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:11.197096 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] PATH_INFO: `/v3/projects/a3f43e60571340dd9ef0a6cca46df7bc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:11.198271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f43e60571340dd9ef0a6cca46df7bc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:11.200234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:11.310257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f43e60571340dd9ef0a6cca46df7bc', 'request_id': 'req-e508cb2d-c10e-4e3d-b35c-1266342c4050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.316865 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f43e60571340dd9ef0a6cca46df7bc', 'request_id': 'req-e508cb2d-c10e-4e3d-b35c-1266342c4050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.322482 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f43e60571340dd9ef0a6cca46df7bc', 'request_id': 'req-e508cb2d-c10e-4e3d-b35c-1266342c4050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.430234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] The token cache is being invalidate because project a3f43e60571340dd9ef0a6cca46df7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:11.430564 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.431191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.432815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1387/2795] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:11 2022] DELETE /identity/v3/projects/a3f43e60571340dd9ef0a6cca46df7bc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:11.437366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:11.447005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827a0a-599a-495d-aaca-50a4bb760181 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:11.451834 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:11.513081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:11.514075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:11.514330 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:11.514617 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] PATH_INFO: `/v3/users/bfdb28d8648f41be8156e59cc0085d03` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:11.515817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfdb28d8648f41be8156e59cc0085d03)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:11.517813 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:11.755327 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdb28d8648f41be8156e59cc0085d03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.755921 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdb28d8648f41be8156e59cc0085d03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.756978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdb28d8648f41be8156e59cc0085d03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.772514 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdb28d8648f41be8156e59cc0085d03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.780911 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-170e7257-a2b8-4032-90a4-5c22b25e3b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdb28d8648f41be8156e59cc0085d03'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:11.888297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1409/2796] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:11 2022] DELETE /identity/v3/users/bfdb28d8648f41be8156e59cc0085d03 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:12.374933 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:12.376394 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:12.394250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508cb2d-c10e-4e3d-b35c-1266342c4050 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:12.438970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:12.451681 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:12.452596 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:12.452883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:12.453160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] PATH_INFO: `/v3/projects/07467d4e794647009b387b6c458030e8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:12.454349 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07467d4e794647009b387b6c458030e8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:12.456268 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:12.585214 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07467d4e794647009b387b6c458030e8', 'request_id': 'req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:12.591211 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07467d4e794647009b387b6c458030e8', 'request_id': 'req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:12.596625 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07467d4e794647009b387b6c458030e8', 'request_id': 'req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:12.695711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] The token cache is being invalidate because project 07467d4e794647009b387b6c458030e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:12.695999 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:12.696667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2bcd183-6bbb-43ae-a05f-7971f8ae5666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:12.698650 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1388/2797] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:12 2022] DELETE /identity/v3/projects/07467d4e794647009b387b6c458030e8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:12.704964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:12.707861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:12.707861 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:12.723391 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:12.724600 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:12.789148 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1410/2798] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:12.797534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:12.797819 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:12.798094 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:12.817109 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:12.818318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:12.827262 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1389/2799] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:12.830817 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:12.840310 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf310f-7dec-4f23-abb0-e728f25b572a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:12.845027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:12.845674 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:12.845956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:12.846226 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:12.846934 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:12.847260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:12.848897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:12.860059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1411/2800] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:12.864236 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:12.874276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7f4ef-6c4f-4192-995a-735ca4027907 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:12.878897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:12.879544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:12.879823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:12.880098 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:12.880821 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:12.882724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:12.970002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1390/2801] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:12 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:12.974195 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:12.985075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8499b-0e3a-49df-bb7b-7b15fead56b7 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:12.996513 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.056171 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.056946 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.057230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.057505 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.058206 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.060131 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.144053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1412/2802] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:12 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:13.148154 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.158726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c188a-248a-4246-b5bf-b6c260a15870 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.163601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.164264 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.164581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.164859 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.165588 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.167191 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.178637 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1391/2803] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:13.182635 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.193393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423639c8-1ada-424e-a90c-2a836e118596 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.198063 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.198720 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.199002 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.199276 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.200036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.201889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dae735-7bce-4dad-b2cc-aec073a6ed9b admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.211562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1413/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:13.215762 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.226206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a955bc-974a-4ca4-bc05-ca85093d22ff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.230763 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.231630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.231907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.232181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] PATH_INFO: `/v3/projects/a622cb49d77a4deabca569c3230a40dc/users/fe816dcfbc4944f99764a6299928a0d4/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.247311 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a622cb49d77a4deabca569c3230a40dc, user_id=fe816dcfbc4944f99764a6299928a0d4, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.250937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.327457 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1392/2805] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:13 2022] PUT /identity/v3/projects/a622cb49d77a4deabca569c3230a40dc/users/fe816dcfbc4944f99764a6299928a0d4/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:13.338807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.339124 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.339411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.376239 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] MFA Rules not processed for user `fe816dcfbc4944f99764a6299928a0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:13.383379 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:13.441709 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1414/2806] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:13.446242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.506885 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd42cb-6013-405a-b770-4d1829b678b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.511554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.512207 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.512509 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.512795 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.513490 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.515581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.619058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.626749 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1393/2807] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:13.630777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.641829 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab425-afba-4964-9077-c2349a100eb7 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.698208 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.698892 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.699176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.699457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.700159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.702376 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.860050 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1415/2808] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:13 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:13.864007 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.875152 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a949b5c-a028-4a5c-9601-de055de50048 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.879675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.880334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.884541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.884541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.884541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.884541 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:13.894473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1394/2809] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:54:13.898551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:13.909511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6491-6a10-469f-9e70-6f1e3e097523 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:13.914080 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976150b0-4971-492c-80fc-153def630735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:13.914960 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976150b0-4971-492c-80fc-153def630735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:13.915238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976150b0-4971-492c-80fc-153def630735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:13.915511 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976150b0-4971-492c-80fc-153def630735 admin admin] PATH_INFO: `/v3/projects/8b3af90bfd534a76bcedc5c9faac543d/users/d2bae990ae7e45108c0d66653b9298e5/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:13.927497 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:13.931323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976150b0-4971-492c-80fc-153def630735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3af90bfd534a76bcedc5c9faac543d, user_id=d2bae990ae7e45108c0d66653b9298e5, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:13.934024 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976150b0-4971-492c-80fc-153def630735 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:14.025866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1416/2810] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:13 2022] PUT /identity/v3/projects/8b3af90bfd534a76bcedc5c9faac543d/users/d2bae990ae7e45108c0d66653b9298e5/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:14.030915 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:14.041937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e421-5078-4f89-bd2d-8621fb8bd51d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:14.099832 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:14.100518 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.100844 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.101126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.101879 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:14.103514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b19c-0ede-4dde-8568-620ca6235c85 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:14.113554 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1395/2811] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:54:14.117504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976150b0-4971-492c-80fc-153def630735 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:14.128067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976150b0-4971-492c-80fc-153def630735 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:14.132712 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:14.133598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.133886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.134164 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] PATH_INFO: `/v3/projects/8b3af90bfd534a76bcedc5c9faac543d/users/d2bae990ae7e45108c0d66653b9298e5/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.136137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3af90bfd534a76bcedc5c9faac543d, user_id=d2bae990ae7e45108c0d66653b9298e5, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:14.139417 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:14.149300 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1417/2812] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:14 2022] PUT /identity/v3/projects/8b3af90bfd534a76bcedc5c9faac543d/users/d2bae990ae7e45108c0d66653b9298e5/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:14.160288 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.160608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.160890 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.187726 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] MFA Rules not processed for user `d2bae990ae7e45108c0d66653b9298e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:14.188987 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:14.256377 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1396/2813] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:14.267864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:14.269586 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:14.328853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52014f-e33f-494c-bac3-75a51bb39fd2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:14.332786 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:14.333879 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.334387 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.334906 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.345176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:14.346739 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea92eb-c0a9-4481-a03a-cedc3117561c service cinder] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:14.356203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1418/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:14.482897 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:14.544453 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816a865-443b-4e45-af24-fbf6b334a36e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:14.549426 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:14.550297 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.550581 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.550857 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] PATH_INFO: `/v3/users/fe816dcfbc4944f99764a6299928a0d4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.552049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe816dcfbc4944f99764a6299928a0d4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:14.554015 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:14.565891 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:14.729510 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe816dcfbc4944f99764a6299928a0d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:14.730192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe816dcfbc4944f99764a6299928a0d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:14.730814 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe816dcfbc4944f99764a6299928a0d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:14.743019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe816dcfbc4944f99764a6299928a0d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:14.750551 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe816dcfbc4944f99764a6299928a0d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:14.841899 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1397/2815] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:14 2022] DELETE /identity/v3/users/fe816dcfbc4944f99764a6299928a0d4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:14.846619 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:14.846910 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:14.847215 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:14.865546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:14.866722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:14.928814 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1419/2816] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:14.939036 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:14.940429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:14.998671 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89bd9-d8c9-4465-8157-c779f77808e1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:15.002606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:15.007770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:15.007770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:15.007770 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:15.012823 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:15.014782 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:15.024224 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1398/2817] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:15.477993 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:15.479413 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:15.493484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92303c3f-1f9c-441e-8e76-a2ab6af01d66 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:15.499806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:15.500969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:15.501386 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:15.501665 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] PATH_INFO: `/v3/projects/a622cb49d77a4deabca569c3230a40dc` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:15.502967 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a622cb49d77a4deabca569c3230a40dc)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:15.508969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:15.614023 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a622cb49d77a4deabca569c3230a40dc', 'request_id': 'req-d08be09a-f613-4816-bba7-427571e4f554'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.620212 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a622cb49d77a4deabca569c3230a40dc', 'request_id': 'req-d08be09a-f613-4816-bba7-427571e4f554'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.704849 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a622cb49d77a4deabca569c3230a40dc', 'request_id': 'req-d08be09a-f613-4816-bba7-427571e4f554'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.716691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] The token cache is being invalidate because project a622cb49d77a4deabca569c3230a40dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:15.717571 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.718399 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.719947 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1420/2818] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:15 2022] DELETE /identity/v3/projects/a622cb49d77a4deabca569c3230a40dc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:15.724373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:15.734632 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cb41-d18a-4483-9944-47645d667ecd service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:15.790322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:15.791193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:15.791478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:15.791757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] PATH_INFO: `/v3/users/d2bae990ae7e45108c0d66653b9298e5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:15.792973 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bae990ae7e45108c0d66653b9298e5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:15.795684 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:15.986686 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:15.998234 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bae990ae7e45108c0d66653b9298e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.998963 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bae990ae7e45108c0d66653b9298e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:15.999590 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bae990ae7e45108c0d66653b9298e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.011052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bae990ae7e45108c0d66653b9298e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.018345 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe37957f-c044-44a5-b1fe-2dc548e3799e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bae990ae7e45108c0d66653b9298e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.127942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1399/2819] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:15 2022] DELETE /identity/v3/users/d2bae990ae7e45108c0d66653b9298e5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:16.580897 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:16.583032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:16.590099 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:16.595779 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be09a-f613-4816-bba7-427571e4f554 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:16.652260 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:16.653184 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:16.653469 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:16.653758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] PATH_INFO: `/v3/projects/8b3af90bfd534a76bcedc5c9faac543d` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:16.655183 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3af90bfd534a76bcedc5c9faac543d)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:16.657130 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:16.778843 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3af90bfd534a76bcedc5c9faac543d', 'request_id': 'req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.785825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3af90bfd534a76bcedc5c9faac543d', 'request_id': 'req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.910776 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3af90bfd534a76bcedc5c9faac543d', 'request_id': 'req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.922724 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] The token cache is being invalidate because project 8b3af90bfd534a76bcedc5c9faac543d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:16.927158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.927158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-dc2ad23b-45cd-4377-af90-c4fb4320ed8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:16.927158 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1421/2820] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:16 2022] DELETE /identity/v3/projects/8b3af90bfd534a76bcedc5c9faac543d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:16.930137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:16.930608 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:16.930721 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:16.948799 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:16.950001 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:17.008045 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1400/2821] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:17.017409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448536-c99f-449e-9679-a368b98214fd None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.017806 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448536-c99f-449e-9679-a368b98214fd None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.018126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448536-c99f-449e-9679-a368b98214fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.036976 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-0f448536-c99f-449e-9679-a368b98214fd None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:17.038181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-0f448536-c99f-449e-9679-a368b98214fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:17.046283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1422/2822] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:17.050413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.059924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe85-3cec-4fda-a66c-ee0d89e7c157 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.065052 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.065711 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.065995 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.066271 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.066996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:17.067308 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.068944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.081034 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1401/2823] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:17.085236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448536-c99f-449e-9679-a368b98214fd None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.094351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448536-c99f-449e-9679-a368b98214fd None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.099011 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.099656 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.099939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.100214 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.100950 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.102824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.185459 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1423/2824] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:17.189423 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.199606 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deabde5-9051-4f87-91b1-a79874b97ce3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.256998 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.257667 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.257950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.258227 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.258925 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.260883 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.379341 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1402/2825] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:17.383205 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.394236 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba3d0-d0a2-41e5-9f74-37e794a203b2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.398886 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.399546 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.399826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.400100 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.400868 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.406866 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.414074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1424/2826] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:17.418473 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.429085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673860d7-74ef-47b8-a2d2-98e766c7b6c6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.433665 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.434325 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.434626 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.434886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.436205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.437768 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dc66e-6c39-4d91-9843-8c799ae3e0de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.447485 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1403/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:17.452137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.462176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76a40-15e8-4b5b-960c-698cb34441ee admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.466842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.467943 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.468224 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.468518 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] PATH_INFO: `/v3/projects/21f0b7f6bcd1490182570877651d359f/users/ebc327ab49a14038b60ada6f43cc6f72/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.483032 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f0b7f6bcd1490182570877651d359f, user_id=ebc327ab49a14038b60ada6f43cc6f72, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.485708 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.584539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1425/2828] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:17 2022] PUT /identity/v3/projects/21f0b7f6bcd1490182570877651d359f/users/ebc327ab49a14038b60ada6f43cc6f72/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:17.594565 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.594858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.595140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.620648 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] MFA Rules not processed for user `ebc327ab49a14038b60ada6f43cc6f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:17.621871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:17.626495 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:17.687362 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1404/2829] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:17.692137 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.723320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:17.753632 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28845af-8fab-4807-93ff-e9b0f106768a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.758275 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.758931 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.759218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.759496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.760181 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.764262 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:17.836989 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1426/2830] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:17.841055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:17.851601 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441cfb7-a1b2-4caa-935e-7355d3cc3879 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:17.910329 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:17.911008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:17.911291 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:17.911567 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:17.912257 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:17.914322 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.007141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1405/2831] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:17 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:18.011055 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:18.021938 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ef57-b12d-4eb7-8763-a01f7f85a332 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:18.026605 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:18.027257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.027535 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.027805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.028543 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:18.030657 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.041230 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1427/2832] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:18.045896 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:18.055796 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c3f1-296f-48df-a631-53a8b17a431a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:18.061084 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:18.061970 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.062253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.062556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] PATH_INFO: `/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2/users/75e75c65d3334bcb86d2a12339d9f2b8/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.077256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a425c1eb064d4e869f52ad8ed022d2, user_id=75e75c65d3334bcb86d2a12339d9f2b8, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:18.080078 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.150959 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1406/2833] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:18 2022] PUT /identity/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2/users/75e75c65d3334bcb86d2a12339d9f2b8/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:18.155190 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:18.165162 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf816ad8-5981-4218-ab7f-51f16046228f admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:18.221519 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:18.222180 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.222461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.222735 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.223456 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:18.225071 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da209d5-49ef-4811-bf67-711726fce5e8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.235454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1428/2834] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:18.239593 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:18.249725 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af62d5-5b79-4d29-8888-0eb5d4014b1c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:18.254305 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:18.255187 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.255468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.255772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] PATH_INFO: `/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2/users/75e75c65d3334bcb86d2a12339d9f2b8/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.257803 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a425c1eb064d4e869f52ad8ed022d2, user_id=75e75c65d3334bcb86d2a12339d9f2b8, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:18.260383 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.270427 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1407/2835] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:18 2022] PUT /identity/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2/users/75e75c65d3334bcb86d2a12339d9f2b8/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:18.281105 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.281401 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.281683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.308117 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] MFA Rules not processed for user `75e75c65d3334bcb86d2a12339d9f2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:18.309351 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:18.375859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1429/2836] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:18.386930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:18.388731 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:18.446356 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f6ac-50b5-4b61-952b-9afe7a76d468 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:18.449916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:18.450550 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:18.450828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:18.451755 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:18.460724 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:18.462149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada428d0-0b27-4a56-b382-ef1c9deacd32 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:18.467459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:18.472058 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1408/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:19.004608 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:19.033040 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:19.068366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0dc0c-9998-431b-8e60-d1391182fabb None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:19.073076 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:19.073944 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:19.074227 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:19.074500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] PATH_INFO: `/v3/users/ebc327ab49a14038b60ada6f43cc6f72` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:19.075680 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc327ab49a14038b60ada6f43cc6f72)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:19.077865 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:19.260320 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc327ab49a14038b60ada6f43cc6f72'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:19.260903 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc327ab49a14038b60ada6f43cc6f72'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:19.261509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc327ab49a14038b60ada6f43cc6f72'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:19.273940 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc327ab49a14038b60ada6f43cc6f72'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:19.281073 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc327ab49a14038b60ada6f43cc6f72'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:19.355490 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1430/2838] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:19 2022] DELETE /identity/v3/users/ebc327ab49a14038b60ada6f43cc6f72 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:19.360848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:19.361375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:19.361487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:19.379184 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:19.380375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:19.439209 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1409/2839] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:19.448949 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:19.450339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:19.506578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f42fe-ca75-4877-8958-450b305851c9 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:19.510286 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:19.510977 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:19.511209 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:19.511484 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:19.520764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:19.523365 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:19.531581 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1431/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:20.009441 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:20.011087 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:20.023259 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a634-b5a9-4c47-977e-064381f43025 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:20.028126 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:20.029682 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:20.030429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:20.030429 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] PATH_INFO: `/v3/projects/21f0b7f6bcd1490182570877651d359f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:20.031544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f0b7f6bcd1490182570877651d359f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:20.033611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:20.190531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f0b7f6bcd1490182570877651d359f', 'request_id': 'req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.196692 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f0b7f6bcd1490182570877651d359f', 'request_id': 'req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.203025 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f0b7f6bcd1490182570877651d359f', 'request_id': 'req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.304165 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] The token cache is being invalidate because project 21f0b7f6bcd1490182570877651d359f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:20.304380 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.305005 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.306612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1410/2841] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:20 2022] DELETE /identity/v3/projects/21f0b7f6bcd1490182570877651d359f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:20.310580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:20.320157 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a08a-208d-434b-bf22-8bcbc5369ac2 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:20.363536 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:20.375875 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:20.376764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:20.377059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:20.377312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] PATH_INFO: `/v3/users/75e75c65d3334bcb86d2a12339d9f2b8` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:20.378500 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e75c65d3334bcb86d2a12339d9f2b8)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:20.380436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:20.586753 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e75c65d3334bcb86d2a12339d9f2b8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.587408 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e75c65d3334bcb86d2a12339d9f2b8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.588053 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e75c65d3334bcb86d2a12339d9f2b8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.599496 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e75c65d3334bcb86d2a12339d9f2b8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.608390 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-421dc6c4-c577-49b1-9c90-304f9ceb0e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e75c65d3334bcb86d2a12339d9f2b8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:20.687728 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1432/2842] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:20 2022] DELETE /identity/v3/users/75e75c65d3334bcb86d2a12339d9f2b8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:21.111709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:21.120693 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:21.127334 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454fc9-f53b-42f1-869e-72a4b25bc8d6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:21.183468 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:21.184332 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.187004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.187004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] PATH_INFO: `/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.187004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a425c1eb064d4e869f52ad8ed022d2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:21.188620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:21.317310 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:21.333130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a425c1eb064d4e869f52ad8ed022d2', 'request_id': 'req-27651966-9edb-40d8-b17f-6d173e670f4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:21.339148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a425c1eb064d4e869f52ad8ed022d2', 'request_id': 'req-27651966-9edb-40d8-b17f-6d173e670f4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:21.345431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a425c1eb064d4e869f52ad8ed022d2', 'request_id': 'req-27651966-9edb-40d8-b17f-6d173e670f4f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:21.470232 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] The token cache is being invalidate because project a2a425c1eb064d4e869f52ad8ed022d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:21.470629 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:21.471656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-27651966-9edb-40d8-b17f-6d173e670f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:21.473314 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1411/2843] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:21 2022] DELETE /identity/v3/projects/a2a425c1eb064d4e869f52ad8ed022d2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:21.478306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.481959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.481959 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.497255 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:21.498471 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:21.556908 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1433/2844] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:21.566570 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.566858 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.567137 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.587040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:21.588243 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:21.596817 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1412/2845] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:21.601019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:21.610994 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c3ba4-0e4d-48b1-9cb2-b4d465c23050 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:21.615640 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:21.616299 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.616613 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.616894 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.617615 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:21.617922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:21.619525 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:21.631067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1434/2846] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:21.635250 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:21.645195 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55924d8-dc43-4657-80c4-8a9a1eee585d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:21.649886 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:21.650540 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.650847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.651127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.651828 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:21.653767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:21.752691 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1413/2847] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:21 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:21.757102 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:21.768837 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a7fca-ffec-45d6-8d19-5febacaa9e9a admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:21.817394 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:21.826648 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:21.827295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:21.827562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:21.827844 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:21.828560 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:21.830486 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:21.985860 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1435/2848] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:21 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:21.990492 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:22.019055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c60d-2dcb-409e-a9d8-6de2c9fe89c1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:22.019055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:22.019055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:22.019055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:22.019710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:22.019710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:22.019710 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:22.032408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1414/2849] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:22.037198 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:22.049127 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc698e7-a16b-4309-a19e-3aec44fe574e admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:22.055185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:22.055969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:22.056339 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:22.056685 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:22.057723 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:22.059479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64076-06df-4ae7-b812-986d720a1e1f admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:22.072256 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1436/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:22.077514 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:22.087778 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dee1b-6e7f-40f6-8960-4e2cf290d9c6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:22.092783 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:22.093780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:22.094090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:22.094402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] PATH_INFO: `/v3/projects/337d23c328ff4a1db342426e1d6a1710/users/47b7c05d452c42e2bded5e684558bf0d/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:22.110204 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d23c328ff4a1db342426e1d6a1710, user_id=47b7c05d452c42e2bded5e684558bf0d, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:22.113256 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:22.219876 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1415/2851] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:22 2022] PUT /identity/v3/projects/337d23c328ff4a1db342426e1d6a1710/users/47b7c05d452c42e2bded5e684558bf0d/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:22.230406 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:22.230694 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:22.230974 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:22.259715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] MFA Rules not processed for user `47b7c05d452c42e2bded5e684558bf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:22.261111 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:22.326751 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1437/2852] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:22.339151 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:22.340953 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:22.397829 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e161-d297-4375-88e3-aa88cefcfffe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:22.401531 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:22.402161 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:22.402445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:22.402720 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:22.410937 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:22.412373 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb07d7-59f8-45fb-ade9-33a7b5d446c0 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:22.421761 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1416/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:32.323070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:32.417024 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:47.432287 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.494653 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e55fe-c258-4adb-8479-65dd318b5f2a None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.499335 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.500203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.500509 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.500792 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] PATH_INFO: `/v3/users/47b7c05d452c42e2bded5e684558bf0d` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.501978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b7c05d452c42e2bded5e684558bf0d)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.504038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.690639 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b7c05d452c42e2bded5e684558bf0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.691341 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b7c05d452c42e2bded5e684558bf0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.691980 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b7c05d452c42e2bded5e684558bf0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.703842 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b7c05d452c42e2bded5e684558bf0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.711251 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b7c05d452c42e2bded5e684558bf0d'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.796291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1438/2854] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:47 2022] DELETE /identity/v3/users/47b7c05d452c42e2bded5e684558bf0d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:47.801640 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.807153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.807153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.819612 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:47.820834 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.879347 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1417/2855] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:47.889041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.890520 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.947683 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33678f-bb9f-4760-b62b-876e20d53668 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.951244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.951893 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.952176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.952452 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.961853 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.963279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974de6-6648-439a-aa91-4ed93625ee71 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.973175 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1439/2856] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:48.409918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:48.411408 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:48.423943 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cec9b-5ffd-40cc-a3e0-215e25597572 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.429099 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.429971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.430253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.430533 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] PATH_INFO: `/v3/projects/337d23c328ff4a1db342426e1d6a1710` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.431767 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=337d23c328ff4a1db342426e1d6a1710)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.433712 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:48.564299 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337d23c328ff4a1db342426e1d6a1710', 'request_id': 'req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:48.571454 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337d23c328ff4a1db342426e1d6a1710', 'request_id': 'req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:48.577085 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337d23c328ff4a1db342426e1d6a1710', 'request_id': 'req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:48.635248 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] The token cache is being invalidate because project 337d23c328ff4a1db342426e1d6a1710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:48.635535 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:48.636182 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8361e004-1b6a-4754-b8a4-8edf8afd1c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:48.637775 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1418/2857] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:48 2022] DELETE /identity/v3/projects/337d23c328ff4a1db342426e1d6a1710 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:48.642691 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.645480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.645480 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.661706 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:48.662901 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:48.680757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:48.722038 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1440/2858] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:48.731176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.732192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.732594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.751193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:48.752388 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:48.761097 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1419/2859] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:48.765342 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:48.775450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136256-d453-4c45-8f6f-3029865bb6ff None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.781033 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.781700 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.781982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.782257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] PATH_INFO: `/v3/domains` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.783009 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80265) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:48.783318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.784954 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:48.796964 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1441/2860] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:48.801669 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:48.810750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18955302-5996-4ea8-ad11-8d51731f6b36 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.815431 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.816630 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.816964 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.817185 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.817873 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.819777 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:48.895083 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1420/2861] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:48 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:54:48.899461 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:48.910279 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864928bf-8e4c-4f14-a1f7-901f40744dec admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.965864 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.966548 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.966812 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.967087 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.967777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.969729 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.055284 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1442/2862] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:48 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:49.059486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.070074 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d55e3-4ecd-4bed-9a84-fa27fe77734e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.074708 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.075386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.075654 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.075990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.076771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.078366 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.088974 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1421/2863] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:49.092918 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.104388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4983b4-83ee-46cb-bc50-931934e9eee2 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.109001 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.109651 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.109929 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.110203 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.111026 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.113956 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887b37-e0c1-4ea4-abdf-e0403ce231fb admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.124393 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1443/2864] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:49.128253 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.138158 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64534bd5-1df7-4caa-b2c1-878d84a0eb33 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.142716 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.143586 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.143867 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.144445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] PATH_INFO: `/v3/projects/06929b24e45545439cc33e50894ce607/users/7251818efb8e43bc90902302f7b482f8/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.158276 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06929b24e45545439cc33e50894ce607, user_id=7251818efb8e43bc90902302f7b482f8, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.161668 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.220035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1422/2865] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:49 2022] PUT /identity/v3/projects/06929b24e45545439cc33e50894ce607/users/7251818efb8e43bc90902302f7b482f8/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:49.226022 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f205cf-c056-4c28-bbf7-768a2eec8a6f None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.226481 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f205cf-c056-4c28-bbf7-768a2eec8a6f None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.226677 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f205cf-c056-4c28-bbf7-768a2eec8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.245820 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-11f205cf-c056-4c28-bbf7-768a2eec8a6f None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:49.247072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-11f205cf-c056-4c28-bbf7-768a2eec8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.306405 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1444/2866] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:49.316576 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.318486 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.340687 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:49.376611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63748-4cb0-4392-9773-c2347ecb003f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.381365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.382122 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.382414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.382736 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.391792 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.393289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.404722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1423/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:50.709439 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dae45-51be-4949-945b-d76d00120b31 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.710036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dae45-51be-4949-945b-d76d00120b31 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.710036 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dae45-51be-4949-945b-d76d00120b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.737020 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c91dae45-51be-4949-945b-d76d00120b31 None None] MFA Rules not processed for user `7251818efb8e43bc90902302f7b482f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:50.738423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c91dae45-51be-4949-945b-d76d00120b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:50.754939 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:50.804354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1445/2868] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:50.815472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.817110 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:50.878148 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcb713-6820-45ee-a7cc-b74b8c6dd724 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.881931 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ec5d01659b2451fbbd9e2d5647b9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.882573 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.882855 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.883124 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.893507 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.895523 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.909679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1424/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:52.748575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bbbc-b94e-4983-a605-721a085d0e41 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:52.749222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bbbc-b94e-4983-a605-721a085d0e41 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:52.749222 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bbbc-b94e-4983-a605-721a085d0e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:52.767345 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-c5a2bbbc-b94e-4983-a605-721a085d0e41 None None] MFA Rules not processed for user `7251818efb8e43bc90902302f7b482f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:52.768979 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-c5a2bbbc-b94e-4983-a605-721a085d0e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:52.775762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1446/2870] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:53.027826 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:53.029244 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:53.041864 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579b878-f990-43c8-81e3-f49bd61d174f service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:53.045501 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:53.046141 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:53.046424 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:53.046700 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:53.048735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:53.058703 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:53.060160 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79c8dc-01d8-4bf9-97d5-688e8055263e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:53.068771 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1425/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:02.762042 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=22 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:03.064539 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=49 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:16.354059 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:16.354584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:16.354584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:16.375676 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] MFA Rules not processed for user `7251818efb8e43bc90902302f7b482f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:16.376924 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:16.383797 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1447/2872] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:26.370097 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:40.714003 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414892-3763-4c01-8100-c836e50fb51d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:40.714487 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414892-3763-4c01-8100-c836e50fb51d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:40.714604 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414892-3763-4c01-8100-c836e50fb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:40.733971 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ea414892-3763-4c01-8100-c836e50fb51d None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:40.735176 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ea414892-3763-4c01-8100-c836e50fb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:40.790192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1426/2873] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:55:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:40.923928 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:40.925375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:40.995411 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd91bea-f0a6-402c-ae6f-07a4d80ab254 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:41.000636 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:41.001298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:41.001582 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:41.001859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:41.009807 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:41.011385 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:41.019584 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1448/2874] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:55:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:55:50.783470 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:51.016323 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=32 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:57.450496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:57.451010 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:57.451674 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:57.469223 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:57.470421 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:57.477506 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1427/2875] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:57.489409 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:57.500521 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589d7b-a3ab-4311-ba7d-09223fb4ef74 service swift] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:57.505577 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:57.506221 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:57.506504 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:57.506782 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:57.515650 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:57.517298 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:57.525578 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1449/2876] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:55:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:00.807907 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:00.821685 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11293632-f18a-44ac-bea9-e6a77ddd9861 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:00.826804 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:00.827679 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:00.827962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:00.828233 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] PATH_INFO: `/v3/users/7251818efb8e43bc90902302f7b482f8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:00.829534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7251818efb8e43bc90902302f7b482f8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:00.832375 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:01.060002 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7251818efb8e43bc90902302f7b482f8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.060678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7251818efb8e43bc90902302f7b482f8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.061340 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7251818efb8e43bc90902302f7b482f8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.073990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7251818efb8e43bc90902302f7b482f8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.081302 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f927d4e-c707-415f-a8fd-026144a9502e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7251818efb8e43bc90902302f7b482f8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.171114 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1428/2877] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:56:00 2022] DELETE /identity/v3/users/7251818efb8e43bc90902302f7b482f8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:01.459790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:01.472242 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783ed8a-0c50-4360-b57e-167672265c85 service swift] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:01.531316 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:01.532170 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.532454 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.532803 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] PATH_INFO: `/v3/projects/06929b24e45545439cc33e50894ce607` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.534081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06929b24e45545439cc33e50894ce607)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:01.535986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:01.670562 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06929b24e45545439cc33e50894ce607', 'request_id': 'req-1be33ef7-5bf8-4850-a316-ef281dcee069'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.677986 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06929b24e45545439cc33e50894ce607', 'request_id': 'req-1be33ef7-5bf8-4850-a316-ef281dcee069'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.755182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06929b24e45545439cc33e50894ce607', 'request_id': 'req-1be33ef7-5bf8-4850-a316-ef281dcee069'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.765904 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] The token cache is being invalidate because project 06929b24e45545439cc33e50894ce607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:56:01.766194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.766828 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-1be33ef7-5bf8-4850-a316-ef281dcee069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.768583 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1450/2878] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:56:01 2022] DELETE /identity/v3/projects/06929b24e45545439cc33e50894ce607 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:01.773595 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.773881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.774153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.792935 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:01.794115 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:01.858402 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1429/2879] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:01.866859 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.867151 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.867436 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.885343 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:01.886539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:01.894827 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1451/2880] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:01.898972 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:01.909881 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534517-529f-4f0c-ae01-dbd0c7409ecf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:01.914556 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:01.915220 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.915502 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.915780 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.916534 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:56:01.916848 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:01.918455 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:01.930986 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1430/2881] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 08:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:56:01.935517 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:01.949424 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f356-317e-4f28-bb54-6d6b0a77301b None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:01.955318 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:01.955981 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.956306 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.956867 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.958159 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:01.960757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.055457 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1452/2882] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:56:01 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:56:02.059496 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.069759 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf18061-4c11-47fc-a660-43c0aca1726b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.117082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:02.125673 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.128575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.128575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.128575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.128575 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.129491 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.229779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1431/2883] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:02.233975 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.244378 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe95d-70c4-481a-bd7d-18dd6c343f16 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.249058 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.249722 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.250008 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.250283 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.251005 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.252818 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.263082 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1453/2884] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:56:02.266945 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.277620 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030416-aabd-407a-9a36-76a6fd9d29ea admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.282497 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.286901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.286901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.286901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.286901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.286901 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5611a-ee49-4754-b21b-cc166814b92f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.297193 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1432/2885] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:02.301388 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.312187 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5ea-ebeb-4bed-a367-49d093119bbf admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.317823 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.318748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.319021 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.319291 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] PATH_INFO: `/v3/projects/b8e2c2ea2a34427d80be32c8a5993538/users/f13196331fb4456abf66f19e65cd234e/roles/1fcd0eca8a9c45a9959c033d5164bf85` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.336126 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e2c2ea2a34427d80be32c8a5993538, user_id=f13196331fb4456abf66f19e65cd234e, role_id=1fcd0eca8a9c45a9959c033d5164bf85)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.338845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.440421 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1454/2886] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:56:02 2022] PUT /identity/v3/projects/b8e2c2ea2a34427d80be32c8a5993538/users/f13196331fb4456abf66f19e65cd234e/roles/1fcd0eca8a9c45a9959c033d5164bf85 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:02.445499 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233832bc-9474-4a71-b0b4-4720491465a2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.445790 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233832bc-9474-4a71-b0b4-4720491465a2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.446071 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233832bc-9474-4a71-b0b4-4720491465a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.463754 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-233832bc-9474-4a71-b0b4-4720491465a2 None None] MFA Rules not processed for user `cbbc2703cf604866b1601e5d461198e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:02.464997 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-233832bc-9474-4a71-b0b4-4720491465a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:02.521815 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1433/2887] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:02.531628 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.533941 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:02.548407 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:02.591711 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cff64-f0fe-4f1e-af02-972eb3f94217 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.595539 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.596246 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.596551 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.596831 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.605707 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.607135 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.616876 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1455/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:08.030443 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.030962 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.031077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.065318 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] MFA Rules not processed for user `f13196331fb4456abf66f19e65cd234e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:08.066538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:08.130779 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1434/2889] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:08.135296 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.145642 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d5e22-3402-492f-9984-e0d973a92fc0 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.150218 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.150889 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.151176 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.151450 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] PATH_INFO: `/v3/projects` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.152140 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.154070 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.266531 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1456/2890] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 08:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:08.271129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.281830 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a44fe-44fd-42ce-ba72-d3a4687d9e43 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.338478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.339150 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.339433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.339709 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.340389 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.342392 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.350437 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:08.447247 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1435/2891] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 08:56:08 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:08.451182 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.462745 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373873-3159-4523-b2c0-fd0cac7a531d admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.467748 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.468423 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.468791 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.469072 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.469805 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.471670 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.483244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1457/2892] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:08.487445 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.498295 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7491474-6bd4-4460-9a96-f46e72e0d57f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.503871 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.504794 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.505077 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.505357 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] PATH_INFO: `/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e/users/0f65dfe281eb4aba9daef08a0d1a1bcb/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.530142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d947ba3e4b542858bdbbdd419cbc74e, user_id=0f65dfe281eb4aba9daef08a0d1a1bcb, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.530142 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.606722 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1436/2893] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:56:08 2022] PUT /identity/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e/users/0f65dfe281eb4aba9daef08a0d1a1bcb/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:08.610715 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.621346 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2583a-066b-4784-8700-07992ec025a9 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.680081 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.680790 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.681075 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.681354 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] PATH_INFO: `/v3/roles` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.682079 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.683668 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2608-8409-4761-a5b0-e1bb8c0e158a admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.693777 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1458/2894] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:08.699594 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:08.709678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e47f-7d05-4ab1-a22e-3cd13479d733 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:08.714944 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:08.716040 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:08.716156 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:08.716371 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] PATH_INFO: `/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e/users/0f65dfe281eb4aba9daef08a0d1a1bcb/roles/e04cfa9b57ea4aafa95819fe6399b453` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:08.718545 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d947ba3e4b542858bdbbdd419cbc74e, user_id=0f65dfe281eb4aba9daef08a0d1a1bcb, role_id=e04cfa9b57ea4aafa95819fe6399b453)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:08.721348 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:08.736578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1437/2895] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 08:56:08 2022] PUT /identity/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e/users/0f65dfe281eb4aba9daef08a0d1a1bcb/roles/e04cfa9b57ea4aafa95819fe6399b453 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:14.579698 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5086a9-8f46-4b76-a0bf-fbed6a6f132c None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:14.580854 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5086a9-8f46-4b76-a0bf-fbed6a6f132c None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:14.580987 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5086a9-8f46-4b76-a0bf-fbed6a6f132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:14.608066 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-3b5086a9-8f46-4b76-a0bf-fbed6a6f132c None None] MFA Rules not processed for user `0f65dfe281eb4aba9daef08a0d1a1bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:14.609235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-3b5086a9-8f46-4b76-a0bf-fbed6a6f132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:14.677762 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1459/2896] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:14.690359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:14.692101 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:14.779229 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c01ca7-4c1d-4f2a-ab65-e6dbe07edb56 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:14.783031 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:14.784472 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:14.784793 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:14.785066 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:14.842961 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:14.844414 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:14.854008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1438/2897] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:15.122825 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915e28-958d-434f-971e-989fa90a89bf None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:15.123120 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915e28-958d-434f-971e-989fa90a89bf None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:15.123444 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915e28-958d-434f-971e-989fa90a89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:15.131598 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:15.143419 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-74915e28-958d-434f-971e-989fa90a89bf None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:15.144596 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-74915e28-958d-434f-971e-989fa90a89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:15.204638 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1460/2898] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:56:15.217611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:15.219950 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:15.277019 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:15.297801 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d79db-330c-447b-ae03-34b56a1afc65 service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:15.303004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:15.303924 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:15.304205 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:15.304516 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:15.312916 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:15.315060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:15.323359 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1439/2899] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:56:25.281701 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=23 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.361611 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.690902 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:25.691185 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:25.691464 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:25.710544 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] MFA Rules not processed for user `f13196331fb4456abf66f19e65cd234e`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:25.711743 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:25.718646 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1461/2900] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 08:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:25.755030 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:25.764478 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b357-4c5e-43bf-8d94-5cd0ec81654b service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:25.769130 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abab3be86e7f48ad8cfc406f4c6c988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:25.771705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:25.771705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:25.771705 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:25.772039 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:25.841218 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:25.842656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a3c49-1937-45e2-8222-51c71d28db56 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:25.853918 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1440/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:26.457942 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:26.459449 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:26.517434 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba500-b9a0-4389-a4de-41a01d620bbe None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:26.521307 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:26.521982 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:26.522297 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:26.522580 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:26.524547 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:26.539887 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:26.541392 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:26.553367 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1462/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:29.419618 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415349-ed13-4b43-8425-b538b4939833 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:29.420127 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415349-ed13-4b43-8425-b538b4939833 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:29.420242 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415349-ed13-4b43-8425-b538b4939833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:29.438418 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-52415349-ed13-4b43-8425-b538b4939833 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:29.440149 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-52415349-ed13-4b43-8425-b538b4939833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:29.447798 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1441/2903] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:56:29.462612 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:29.474602 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e67cc-82f0-4606-a16f-d90155a9d0cf service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:29.480027 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:29.480793 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:29.481074 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:29.481366 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:29.490194 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:29.491764 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:29.500238 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1463/2904] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:39.432990 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=37 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:39.496784 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=35 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:01.827471 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415349-ed13-4b43-8425-b538b4939833 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:01.837413 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415349-ed13-4b43-8425-b538b4939833 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:01.841111 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:01.842390 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:01.842672 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:01.842942 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:01.844750 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:01.855578 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:01.857046 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:01.866706 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1442/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:01.988631 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:01.997990 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f0256-a493-48ce-8814-01f7cf6a1c6e service swift] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:02.001594 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f74aa6096fb4f1aa6f239f39b670712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:02.002245 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:02.002555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:02.002882 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:02.012257 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:02.013826 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:02.023658 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1464/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:03.850277 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:03.856324 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:03.869129 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382918-3ad2-422b-8c1a-ead661632425 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:03.874772 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:03.879132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:03.879132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:03.879132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:03.879132 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:03.890735 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:03.892386 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:03.906433 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1443/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:12.019382 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=6 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:13.900592 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=12 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:00.053667 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:00.055056 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:00.190575 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5898-d184-4d39-84f5-39367df50580 service neutron] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:00.197688 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:00.198771 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:00.199235 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:00.199692 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:00.202772 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:00.217872 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:00.219479 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce29f3-a522-4ba6-8e8e-aba34734cc57 service placement] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:00.229734 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1465/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:10.225463 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=63 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:31.898524 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:31.900179 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:31.965875 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6ee2-a75e-42f7-ba57-30451b331856 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:31.971544 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd125909b383a44b49e94715bde34866c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:31.972194 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:31.972480 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:31.972787 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:31.974624 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:31.987055 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:31.988680 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:32.000042 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1444/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:34.201621 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] REQUEST_METHOD: `POST` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:34.202108 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:34.202250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:34.229529 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.auth.core [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] MFA Rules not processed for user `a8e733e298f84d75adfe1ef616c4574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80265) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:34.231375 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:34.243264 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1466/2910] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 08:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:34.284153 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:34.296580 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6c1cc-13af-47f1-8a10-fa25dc2d0c02 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:34.301643 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad40b6b9b26414a9d87746b77c9e560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:34.302289 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:34.303076 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:34.303459 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:34.312060 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:34.313675 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:34.323339 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1445/2911] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 08:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:39.296312 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.311019 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8ec86-5ab3-466d-b999-f1992901eb58 None None] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.319725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.319725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] REQUEST_METHOD: `GET` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.319725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.319725 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.323410 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:39.333314 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.335824 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.346576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1467/2912] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:43.279189 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:43.362213 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906272-ca8f-498c-b6f7-1d8b6ea93932 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:43.367448 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:43.368444 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:43.368734 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:43.369009 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] PATH_INFO: `/v3/users/f13196331fb4456abf66f19e65cd234e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:43.370241 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13196331fb4456abf66f19e65cd234e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:43.372192 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:43.600757 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13196331fb4456abf66f19e65cd234e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.606053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13196331fb4456abf66f19e65cd234e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.606053 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13196331fb4456abf66f19e65cd234e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.614004 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13196331fb4456abf66f19e65cd234e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.619206 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:43.622082 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13196331fb4456abf66f19e65cd234e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.723678 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1446/2913] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:43 2022] DELETE /identity/v3/users/f13196331fb4456abf66f19e65cd234e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:43.999922 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:44.013978 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f276-d86a-4a4b-8657-726d48056429 service placement] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:44.077107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:44.078540 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.079046 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.079643 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] PATH_INFO: `/v3/projects/b8e2c2ea2a34427d80be32c8a5993538` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.081244 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e2c2ea2a34427d80be32c8a5993538)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:44.083555 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:44.187758 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e2c2ea2a34427d80be32c8a5993538', 'request_id': 'req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.194878 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e2c2ea2a34427d80be32c8a5993538', 'request_id': 'req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.256845 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e2c2ea2a34427d80be32c8a5993538', 'request_id': 'req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.285067 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] The token cache is being invalidate because project b8e2c2ea2a34427d80be32c8a5993538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:44.285332 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.285997 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.288204 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1468/2914] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:43 2022] DELETE /identity/v3/projects/b8e2c2ea2a34427d80be32c8a5993538 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:44.292566 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:44.294138 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:44.307387 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a9e1-5edb-4432-bddb-5529c03f64c2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:44.364847 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:44.365809 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.366090 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.366365 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] PATH_INFO: `/v3/users/0f65dfe281eb4aba9daef08a0d1a1bcb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.367538 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f65dfe281eb4aba9daef08a0d1a1bcb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:44.370285 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:44.746363 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f65dfe281eb4aba9daef08a0d1a1bcb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.747050 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f65dfe281eb4aba9daef08a0d1a1bcb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.747656 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f65dfe281eb4aba9daef08a0d1a1bcb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.760062 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f65dfe281eb4aba9daef08a0d1a1bcb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.767159 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f65dfe281eb4aba9daef08a0d1a1bcb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.872688 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1447/2915] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:44 2022] DELETE /identity/v3/users/0f65dfe281eb4aba9daef08a0d1a1bcb => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:45.160326 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Authenticating user token {{(pid=80265) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:45.162874 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.fernet_utils [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80265) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:45.176250 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15769-fa7e-4a8d-9142-b0900a3dc5a8 admin admin] Validating token access rules against request {{(pid=80265) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:45.236025 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbc2703cf604866b1601e5d461198e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d4449a875a4811837ecf2ea9ba71ec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80265) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:45.237372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.237372 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.237623 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] PATH_INFO: `/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e` {{(pid=80265) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.238652 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d947ba3e4b542858bdbbdd419cbc74e)` {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:45.241591 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] RBAC: Authorization granted {{(pid=80265) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:45.243295 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:45.385969 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d947ba3e4b542858bdbbdd419cbc74e', 'request_id': 'req-51fb51d5-0bf6-499c-a778-349e13b88c28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:45.392107 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d947ba3e4b542858bdbbdd419cbc74e', 'request_id': 'req-51fb51d5-0bf6-499c-a778-349e13b88c28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:45.458815 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d947ba3e4b542858bdbbdd419cbc74e', 'request_id': 'req-51fb51d5-0bf6-499c-a778-349e13b88c28'} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:45.470473 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] The token cache is being invalidate because project 8d947ba3e4b542858bdbbdd419cbc74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80265) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:45.470757 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:45.472576 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG keystone.notifications [None req-51fb51d5-0bf6-499c-a778-349e13b88c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80265) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:45.473041 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: [pid: 80265|app: 0|req: 1469/2916] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:45 2022] DELETE /identity/v3/projects/8d947ba3e4b542858bdbbdd419cbc74e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:54.868984 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=57,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:55.467252 dv-cinder-803773-4-iscsi devstack@keystone.service[80265]: DEBUG dbcounter [-] [80265] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:05.081789 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:05.083181 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:05.153996 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817c2d-8947-45be-ac7c-338f62eeb841 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:05.214168 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b199ab9b81fd4bfa8f2282e45971a269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f2d6777e3d4fcfa13e43935c1f2d61', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:05.214732 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:05.215008 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:05.215273 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:05.217049 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:05.228440 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:05.230035 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa474b-1092-47bb-b5de-01764b2a4dd1 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:05.240140 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1448/2917] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:15.235930 dv-cinder-803773-4-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=58 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}